[ 578.818583] env[69647]: INFO neutron.common.config [-] Logging enabled! [ 578.818845] env[69647]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev54 [ 578.819052] env[69647]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69647) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 578.819347] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 578.819466] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 578.820294] env[69647]: WARNING oslo_policy.policy [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 578.820512] env[69647]: WARNING oslo_policy.policy [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 578.821964] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] VMware NSXv3 Agent initialized successfully. [ 578.822337] env[69647]: DEBUG oslo_concurrency.lockutils [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] Acquiring lock "singleton_lock" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.822475] env[69647]: DEBUG oslo_concurrency.lockutils [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] Acquired lock "singleton_lock" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.822684] env[69647]: DEBUG oslo_concurrency.lockutils [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] Releasing lock "singleton_lock" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.822974] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] Full set of CONF: {{(pid=69647) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 578.823194] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ******************************************************************************** {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 578.823312] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] Configuration options gathered from: {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 578.823561] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 578.823740] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 578.823855] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ================================================================================ {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 578.824042] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] agent_down_time = 75 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.824196] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] allow_automatic_dhcp_failover = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.824341] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] allow_bulk = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.824578] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] api_extensions_path = {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.824629] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] api_paste_config = api-paste.ini {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.824779] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] auth_strategy = keystone {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.825141] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] backdoor_port = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.825373] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] backdoor_socket = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.825549] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] backlog = 4096 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.825880] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.826127] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] bind_host = 0.0.0.0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.826443] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] bind_port = 9696 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.826655] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] client_socket_timeout = 900 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.826963] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] config_dir = [] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.827143] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.827310] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] config_source = [] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.827485] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] control_exchange = neutron {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.827648] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] core_plugin = ml2 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.827804] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] debug = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.827960] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] default_availability_zones = [] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.828193] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.828345] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] dhcp_agent_notification = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.828490] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] dhcp_agents_per_network = 1 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.828636] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] dhcp_lease_duration = 86400 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.828879] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] dhcp_load_type = networks {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.829051] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] dns_domain = openstacklocal {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.829202] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.829349] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] enable_default_route_bfd = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.829516] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] enable_default_route_ecmp = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.829664] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] enable_dvr = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.829804] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] enable_new_agents = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.829942] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.830092] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] enable_signals = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.830234] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] enable_traditional_dhcp = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.830371] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] external_dns_driver = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.830533] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] filter_validation = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.830691] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] global_physnet_mtu = 8950 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.830835] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] graceful_shutdown_timeout = 60 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.831033] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] host = cpu-1 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.831188] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] host_dvr_for_dhcp = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.831334] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] http_retries = 3 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.831484] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] instance_format = [instance: %(uuid)s] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.831633] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.831776] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ipam_driver = internal {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.831916] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ipv6_pd_enabled = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.832069] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] l3_ha = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.832219] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.832365] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] l3_ha_network_physical_name = {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.832511] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] l3_ha_network_type = {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.832662] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] log_color = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.832806] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] log_config_append = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.832953] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.833108] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] log_dir = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.833249] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] log_file = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.833358] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] log_options = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.833502] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] log_rotate_interval = 1 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.833656] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] log_rotate_interval_type = days {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.833803] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] log_rotation_type = none {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.833915] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.834035] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.834191] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.834341] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.834454] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.834599] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] max_dns_nameservers = 5 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.834741] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] max_header_line = 16384 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.834880] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] max_l3_agents_per_router = 3 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.835027] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] max_logfile_count = 30 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.835170] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] max_logfile_size_mb = 200 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.835309] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] max_subnet_host_routes = 20 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.835456] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] my_ip = 10.180.1.21 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.835603] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] my_ipv6 = ::1 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.835744] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] network_auto_schedule = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.835879] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] network_link_prefix = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.836035] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.836187] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] notify_nova_on_port_data_changes = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.836333] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] notify_nova_on_port_status_changes = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.836481] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] pagination_max_limit = -1 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.836624] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] publish_errors = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.836765] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] rate_limit_burst = 0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.836912] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] rate_limit_except_level = CRITICAL {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.837065] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] rate_limit_interval = 0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.837212] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] retry_until_window = 30 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.837353] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] router_distributed = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.837519] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] rpc_resources_processing_step = 20 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.837667] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] rpc_response_max_timeout = 600 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.837812] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] rpc_response_timeout = 60 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.837955] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] send_events_interval = 2 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.838131] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] service_plugins = ['router'] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.838284] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] setproctitle = on {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.838422] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] shell_completion = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.838572] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] state_path = /opt/stack/data/neutron {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.838720] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] syslog_log_facility = LOG_USER {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.838863] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] tcp_keepidle = 600 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.839014] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] transport_url = **** {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.839162] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] use_journal = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.839299] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] use_json = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.839457] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] use_ssl = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.839603] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] use_stderr = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.839752] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] use_syslog = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.839892] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] vlan_qinq = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.840041] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] vlan_transparent = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.840184] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] watch_log_file = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.840325] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] wsgi_default_pool_size = 100 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.840464] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] wsgi_keep_alive = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.840615] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.840755] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] wsgi_server_debug = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 578.840911] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_concurrency.disable_process_locking = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.841075] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.841232] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.841376] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.841529] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.841679] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.841824] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.841982] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler.connection_string = messaging:// {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.842143] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler.enabled = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.842293] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler.es_doc_type = notification {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.842439] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler.es_scroll_size = 10000 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.842590] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler.es_scroll_time = 2m {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.842731] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler.filter_error_trace = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.842878] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler.hmac_keys = **** {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.843037] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler.sentinel_service_name = mymaster {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.843191] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler.socket_timeout = 0.1 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.843334] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler.trace_requests = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.843478] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler.trace_sqlalchemy = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.843633] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler_jaeger.process_tags = {} {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.843774] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler_jaeger.service_name_prefix = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.843917] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] profiler_otlp.service_name_prefix = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.844085] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_policy.enforce_new_defaults = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.844359] env[69647]: WARNING oslo_config.cfg [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 578.844516] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_policy.enforce_scope = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.844669] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_policy.policy_default_rule = default {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.844826] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.844975] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.845139] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.845283] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.845428] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.845570] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.845712] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.845862] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.846032] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.846189] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] agent.extensions = [] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.846337] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.846486] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] service_providers.service_provider = [] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.846642] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] QUOTAS.default_quota = -1 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.846791] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.846937] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] QUOTAS.quota_floatingip = 50 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.847091] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] QUOTAS.quota_network = 100 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.847238] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] QUOTAS.quota_port = 500 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.847384] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.847542] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] QUOTAS.quota_router = 10 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.847690] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] QUOTAS.quota_security_group = 10 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.847834] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.847977] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] QUOTAS.quota_subnet = 100 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.848133] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] QUOTAS.track_quota_usage = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.848292] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.848436] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep.group = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.848577] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep.helper_command = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.848724] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.848869] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep.thread_pool_size = 8 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.849014] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep.user = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.849169] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.849310] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_dhcp_release.group = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.849472] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_dhcp_release.helper_command = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.849629] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.849775] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.849914] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_dhcp_release.user = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.850073] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.850218] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_ovs_vsctl.group = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.850359] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.850506] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.850653] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.850863] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_ovs_vsctl.user = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.851040] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_namespace.capabilities = [21] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.851185] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_namespace.group = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.851327] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_namespace.helper_command = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.851474] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.851622] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.851784] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_namespace.user = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.851948] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_conntrack.capabilities = [12] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.852105] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_conntrack.group = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.852247] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_conntrack.helper_command = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.852394] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.852542] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.852681] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_conntrack.user = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.852828] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_link.capabilities = [12, 21] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.852966] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_link.group = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.853117] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_link.helper_command = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.853261] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.853405] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_link.thread_pool_size = 8 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.853544] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] privsep_link.user = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.853702] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.853856] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.854009] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.continue_on_failed_promotions = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.854157] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.dscp = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.854300] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.dscp_inherit = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.854451] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.force_mp_to_policy = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.854596] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.locking_coordinator_url = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.854737] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.log_agent_heartbeats = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.854882] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.logging_expire = 1 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.855040] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.855189] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.855341] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.polling_interval = 240 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.855487] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.855638] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.855786] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.report_interval = 30.0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.855936] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.856095] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.856248] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.856395] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.sync_skew = 60 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.856544] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.synchronization_queue_size = 20 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.856690] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT.use_helper_for_ns_read = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.856840] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] SECURITYGROUP.enable_ipset = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.856991] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] SECURITYGROUP.enable_security_group = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.857153] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.857304] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.857460] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] experimental.ipv6_pd_enabled = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.857630] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ml2.extension_drivers = ['port_security'] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.857774] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ml2.external_network_type = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.857932] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.858097] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ml2.overlay_ip_version = 4 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.858253] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ml2.path_mtu = 8950 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.858402] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ml2.physical_network_mtus = {} {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.858558] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.858710] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.858864] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ml2.type_drivers = ['vlan'] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.859029] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.859170] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.859316] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.859497] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.859658] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.859810] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.859962] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.860127] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.860277] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.860491] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.860650] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_login_password = **** {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.860805] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.860958] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_login_user = admin {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.861120] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.861276] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.861426] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.861572] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.861733] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.861901] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.862067] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.862220] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.862368] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.862523] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.862678] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.862827] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.862976] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.863189] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.863348] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.863502] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.863654] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.863805] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] nova.auth_section = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.863962] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] nova.auth_type = password {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.864124] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.864268] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] nova.certfile = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.864414] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] nova.collect_timing = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.864577] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] nova.endpoint_type = public {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.864725] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] nova.insecure = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.864865] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] nova.keyfile = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.865026] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] nova.region_name = RegionOne {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.865176] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] nova.split_loggers = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.865320] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] nova.timeout = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.865470] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] placement.auth_section = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.865625] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] placement.auth_type = password {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.865777] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.865919] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] placement.certfile = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.866076] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] placement.collect_timing = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.866230] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] placement.endpoint_type = public {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.866375] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] placement.insecure = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.866518] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] placement.keyfile = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.866656] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] placement.region_name = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.866796] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] placement.split_loggers = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.866935] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] placement.timeout = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.867113] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.auth_section = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.867264] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.auth_type = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.867407] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.cafile = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.867549] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.certfile = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.867693] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.collect_timing = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.867834] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.connect_retries = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.867972] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.connect_retry_delay = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.868169] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.enable_notifications = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.868260] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.endpoint_override = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.868405] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.insecure = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.868548] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.interface = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.868687] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.keyfile = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.868823] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.max_version = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.868961] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.min_version = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.869110] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.region_name = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.869249] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.retriable_status_codes = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.869390] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.service_name = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.869547] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.service_type = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.869696] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.split_loggers = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.869835] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.status_code_retries = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.869973] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.status_code_retry_delay = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.870126] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.timeout = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.870265] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.valid_interfaces = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.870404] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ironic.version = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.870556] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] cli_script.dry_run = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.870710] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.870930] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.870989] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.871148] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.871291] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.871464] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.871570] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.871716] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.871861] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.872027] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.872175] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.872329] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.872480] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.872630] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.872775] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.872925] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.873080] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.873228] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.873378] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.873523] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.873666] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.873815] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.873963] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.874120] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.874266] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.874409] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.874550] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.874695] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.874838] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.874981] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.875137] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.ssl = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.875291] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.875441] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.875588] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.875738] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.875887] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.876041] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.876245] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_notifications.driver = [] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.876352] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_notifications.retry = -1 {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.876495] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.876639] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 578.876750] env[69647]: DEBUG oslo_service.backend.eventlet.service [None req-111870c1-fbab-4076-b8ac-aca79a264386 None None] ******************************************************************************** {{(pid=69647) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 578.877771] env[69647]: DEBUG neutron.agent.securitygroups_rpc [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Init firewall settings (driver=nsxv3) {{(pid=69647) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 578.879112] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69647) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 578.879368] env[69647]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] RPC agent_id: nsxm-l-01a.corp.local [ 578.881696] env[69647]: DEBUG dogpile.cache.region [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 578.881762] env[69647]: DEBUG dogpile.lock [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 578.881855] env[69647]: DEBUG dogpile.lock [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 578.881947] env[69647]: DEBUG dogpile.lock [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 578.882054] env[69647]: DEBUG dogpile.cache.region [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 578.882144] env[69647]: DEBUG dogpile.lock [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 578.882268] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 578.906639] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Session token - acquiring [ 578.908353] env[69647]: DEBUG networking_nsxv3.common.locking [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.908533] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.908633] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.909055] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.918628] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.178495] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 579.207661] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 579.207795] env[69647]: DEBUG dogpile.cache.region [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Cache value generated in 0.325 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 579.207912] env[69647]: DEBUG dogpile.lock [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 579.208051] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Activating Policy API Provider. [ 579.208263] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Looking for the default Infrastructure Rules. [ 579.267913] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Looking for the Default Layer3 Logged Drop Section. [ 579.280293] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 579.280724] env[69647]: DEBUG networking_nsxv3.common.locking [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.280895] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquiring lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.280993] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.281280] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired external semaphore "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.281610] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.797857] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.299780] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.802249] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Inventory metadata is going to be refreshed. [ 580.802435] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 581.548161] env[69647]: DEBUG networking_nsxv3.common.locking [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.548678] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.548678] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.548792] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.663074] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 581.663984] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.664890] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 581.681089] env[69647]: DEBUG networking_nsxv3.common.locking [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.681394] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.681394] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.681680] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.681806] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.681956] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 581.682087] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 581.682210] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 581.702315] env[69647]: DEBUG networking_nsxv3.common.locking [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.702541] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.702611] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.702835] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.703018] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.703170] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 581.722859] env[69647]: DEBUG networking_nsxv3.common.locking [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.723137] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.723137] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.723415] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.723553] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.723818] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 581.740287] env[69647]: DEBUG networking_nsxv3.common.locking [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.740476] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquiring lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.740582] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.740837] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired external semaphore "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.740972] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Releasing lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.741135] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 581.741242] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 581.741347] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 581.758526] env[69647]: DEBUG networking_nsxv3.common.locking [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.758668] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquiring lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.758884] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.759037] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired external semaphore "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.759167] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Releasing lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.759304] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 581.759408] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 581.759564] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 581.777505] env[69647]: DEBUG networking_nsxv3.common.locking [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.777681] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.777809] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.778070] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.778213] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.778362] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 581.778469] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 581.778572] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Inventory metadata have been refreshed. [ 581.778670] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Dryrun:True. Metadata refresh completed. [ 581.778787] env[69647]: DEBUG oslo_concurrency.lockutils [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Releasing lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.780514] env[69647]: INFO neutron.agent.agent_extensions_manager [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Loaded agent extensions: [] [ 581.781238] env[69647]: DEBUG neutron_lib.callbacks.manager [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69647) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 581.828952] env[69647]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] NSXv3 Agent Agent RPC Daemon Started! [ 581.829089] env[69647]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] NSXv3 Agent Agent loop - iteration:0 started [ 581.829193] env[69647]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] NSXv3 Agent Agent out of sync with plugin! [ 586.781567] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 586.782034] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 591.783030] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 591.783485] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 595.916226] env[69647]: INFO networking_nsxv3.common.synchronization [None req-cfea688e-03aa-417f-adf4-be17a5bf4c61 demo admin] Enqueued Resource ID: 1ab957bc-cf54-4329-8a9e-76409010998e with Priority: HIGHEST for action security_group_rules [ 595.916226] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ab957bc-cf54-4329-8a9e-76409010998e with Priority: HIGHEST for action security_group_rules [ 595.916226] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ab957bc-cf54-4329-8a9e-76409010998e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.916226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ab957bc-cf54-4329-8a9e-76409010998e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.916226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ab957bc-cf54-4329-8a9e-76409010998e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.916730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ab957bc-cf54-4329-8a9e-76409010998e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.916935] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ab957bc-cf54-4329-8a9e-76409010998e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.438496] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.438496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.438496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.438496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.438496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.438496] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ab957bc-cf54-4329-8a9e-76409010998e already deleted. [ 596.438496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ab957bc-cf54-4329-8a9e-76409010998e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.785397] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.785397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.785397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.785397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.785397] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.291859] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.794153] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.296322] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 598.296779] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 599.000179] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.000426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.000426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.000618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.010567] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 599.011381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.011999] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 599.026716] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.026856] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.026898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.027089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.027173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.027276] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 599.027347] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 599.027415] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 599.044585] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.044741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.044817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.044932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.045067] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.045168] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 599.062893] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.063050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.063107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.063246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.063337] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.063433] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 599.079055] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.079193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.079232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.079369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.079457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.079555] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 599.079626] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 599.079695] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 599.095184] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.095300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.095370] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.095517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.095594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.095686] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 599.095756] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 599.095826] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 599.114930] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.115083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.115141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.115274] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.115362] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.115461] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 599.115532] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 599.115599] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 599.115664] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 599.115737] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 599.115802] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 599.115862] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 599.116134] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 599.116201] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 599.116265] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 599.133608] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.133739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.133777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.133927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.134030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.134127] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 599.150883] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.150999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.151080] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.151238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.151326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.161900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.916233] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 600.916642] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 605.917082] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 605.917506] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 610.918464] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 610.918817] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 615.919085] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 615.919441] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 620.920199] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 620.920484] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 621.951782] env[69647]: INFO networking_nsxv3.common.synchronization [None req-274ebc60-3564-4105-9236-09ec5f520f7b None None] Enqueued Resource ID: 34ecba86-d053-4a54-a18b-c8dbc27031e6 with Priority: HIGHEST for action port [ 621.952999] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ecba86-d053-4a54-a18b-c8dbc27031e6 with Priority: HIGHEST for action port [ 621.952999] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-34ecba86-d053-4a54-a18b-c8dbc27031e6 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.952999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34ecba86-d053-4a54-a18b-c8dbc27031e6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.952999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34ecba86-d053-4a54-a18b-c8dbc27031e6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.953475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34ecba86-d053-4a54-a18b-c8dbc27031e6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.953475] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34ecba86-d053-4a54-a18b-c8dbc27031e6',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.455094] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34ecba86-d053-4a54-a18b-c8dbc27031e6 [ 622.455359] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.455504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.455584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.455771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.455854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.455947] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34ecba86-d053-4a54-a18b-c8dbc27031e6 already deleted. [ 622.456034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34ecba86-d053-4a54-a18b-c8dbc27031e6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.871674] env[69647]: INFO networking_nsxv3.common.synchronization [None req-3a6c0bd7-4417-4d15-a220-588104c14d6f None None] Enqueued Resource ID: a1493966-7629-4131-ba03-aa7be5ec3fad with Priority: HIGHEST for action port [ 623.871674] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1493966-7629-4131-ba03-aa7be5ec3fad with Priority: HIGHEST for action port [ 623.871974] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1493966-7629-4131-ba03-aa7be5ec3fad taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.872091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1493966-7629-4131-ba03-aa7be5ec3fad" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.872091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1493966-7629-4131-ba03-aa7be5ec3fad" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.873503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1493966-7629-4131-ba03-aa7be5ec3fad" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.873503] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1493966-7629-4131-ba03-aa7be5ec3fad',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.375410] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1493966-7629-4131-ba03-aa7be5ec3fad [ 624.375650] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.375789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.375863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.376303] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.376431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.376562] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1493966-7629-4131-ba03-aa7be5ec3fad already deleted. [ 624.376610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1493966-7629-4131-ba03-aa7be5ec3fad" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.277152] env[69647]: INFO networking_nsxv3.common.synchronization [None req-197197ac-e77e-4510-8f23-7ba6bf4f066d None None] Enqueued Resource ID: 262f109b-2814-4a07-b358-2afb465ed770 with Priority: HIGHEST for action port [ 626.277912] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 262f109b-2814-4a07-b358-2afb465ed770 with Priority: HIGHEST for action port [ 626.278107] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-262f109b-2814-4a07-b358-2afb465ed770 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.278164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-262f109b-2814-4a07-b358-2afb465ed770" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.278275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-262f109b-2814-4a07-b358-2afb465ed770" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.278460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-262f109b-2814-4a07-b358-2afb465ed770" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.278535] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('262f109b-2814-4a07-b358-2afb465ed770',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.781258] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 262f109b-2814-4a07-b358-2afb465ed770 [ 626.781258] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.782471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.782471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.782471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.782471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.782471] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:262f109b-2814-4a07-b358-2afb465ed770 already deleted. [ 626.782851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-262f109b-2814-4a07-b358-2afb465ed770" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.927473] env[69647]: INFO networking_nsxv3.common.synchronization [None req-68626967-3d70-467d-acfc-498210e1e113 None None] Enqueued Resource ID: a7ca7ed2-52ac-4eea-8aee-7184c0d792e7 with Priority: HIGHEST for action port [ 627.927473] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ca7ed2-52ac-4eea-8aee-7184c0d792e7 with Priority: HIGHEST for action port [ 627.929629] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7ca7ed2-52ac-4eea-8aee-7184c0d792e7 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.929699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7ca7ed2-52ac-4eea-8aee-7184c0d792e7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.929785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7ca7ed2-52ac-4eea-8aee-7184c0d792e7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.930093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7ca7ed2-52ac-4eea-8aee-7184c0d792e7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.930190] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7ca7ed2-52ac-4eea-8aee-7184c0d792e7',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.107121] env[69647]: INFO networking_nsxv3.common.synchronization [None req-3d9a806b-28c2-4b95-baf3-2e3e260b07fd None None] Enqueued Resource ID: 818fac72-7a20-41e0-a700-d1dc3207752b with Priority: HIGHEST for action port [ 628.107628] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 818fac72-7a20-41e0-a700-d1dc3207752b with Priority: HIGHEST for action port [ 628.108325] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-818fac72-7a20-41e0-a700-d1dc3207752b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.108453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-818fac72-7a20-41e0-a700-d1dc3207752b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.108778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-818fac72-7a20-41e0-a700-d1dc3207752b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.109179] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-818fac72-7a20-41e0-a700-d1dc3207752b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.109179] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('818fac72-7a20-41e0-a700-d1dc3207752b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.432166] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7ca7ed2-52ac-4eea-8aee-7184c0d792e7 [ 628.434348] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.434510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.434580] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.434840] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.434935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.435104] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7ca7ed2-52ac-4eea-8aee-7184c0d792e7 already deleted. [ 628.435358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7ca7ed2-52ac-4eea-8aee-7184c0d792e7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.611981] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 818fac72-7a20-41e0-a700-d1dc3207752b [ 628.612615] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.613928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.615123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.615123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.615123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.615123] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:818fac72-7a20-41e0-a700-d1dc3207752b already deleted. [ 628.615123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-818fac72-7a20-41e0-a700-d1dc3207752b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.942702] env[69647]: INFO networking_nsxv3.common.synchronization [None req-107572c0-4b4e-4458-b437-d1386772473d None None] Enqueued Resource ID: c8aa3867-40cf-49b4-b414-b9f6881c9f36 with Priority: HIGHEST for action port [ 628.942702] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8aa3867-40cf-49b4-b414-b9f6881c9f36 with Priority: HIGHEST for action port [ 628.942702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8aa3867-40cf-49b4-b414-b9f6881c9f36 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.942702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8aa3867-40cf-49b4-b414-b9f6881c9f36" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.942702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8aa3867-40cf-49b4-b414-b9f6881c9f36" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.943191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8aa3867-40cf-49b4-b414-b9f6881c9f36" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.943191] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8aa3867-40cf-49b4-b414-b9f6881c9f36',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.307936] env[69647]: INFO networking_nsxv3.common.synchronization [None req-705e5b82-7f13-4453-96cf-0e883374ccae None None] Enqueued Resource ID: b5011032-c294-4c91-847f-0c93281dcc91 with Priority: HIGHEST for action port [ 629.308269] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5011032-c294-4c91-847f-0c93281dcc91 with Priority: HIGHEST for action port [ 629.308818] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5011032-c294-4c91-847f-0c93281dcc91 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.309145] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5011032-c294-4c91-847f-0c93281dcc91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.309145] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5011032-c294-4c91-847f-0c93281dcc91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.309325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5011032-c294-4c91-847f-0c93281dcc91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.309353] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5011032-c294-4c91-847f-0c93281dcc91',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.445024] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8aa3867-40cf-49b4-b414-b9f6881c9f36 [ 629.445138] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.446513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.446513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.446513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.446513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.446513] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8aa3867-40cf-49b4-b414-b9f6881c9f36 already deleted. [ 629.446513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8aa3867-40cf-49b4-b414-b9f6881c9f36" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.813582] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5011032-c294-4c91-847f-0c93281dcc91 [ 629.813582] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.813582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.813582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.813582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.813582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.813582] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5011032-c294-4c91-847f-0c93281dcc91 already deleted. [ 629.813582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5011032-c294-4c91-847f-0c93281dcc91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.840385] env[69647]: INFO networking_nsxv3.common.synchronization [None req-3b9a2191-5412-4754-9acd-b1846047896c None None] Enqueued Resource ID: 999bc882-5526-4fb9-ad46-b6a148548e82 with Priority: HIGHEST for action port [ 629.840385] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 999bc882-5526-4fb9-ad46-b6a148548e82 with Priority: HIGHEST for action port [ 629.840385] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-999bc882-5526-4fb9-ad46-b6a148548e82 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.840385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-999bc882-5526-4fb9-ad46-b6a148548e82" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.840385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-999bc882-5526-4fb9-ad46-b6a148548e82" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.841523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-999bc882-5526-4fb9-ad46-b6a148548e82" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.843590] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('999bc882-5526-4fb9-ad46-b6a148548e82',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.270830] env[69647]: INFO networking_nsxv3.common.synchronization [None req-2457999d-9294-4e71-b767-4e47ad3c7a2c None None] Enqueued Resource ID: 3b85fbdb-5945-4de0-aa08-043822483a8a with Priority: HIGHEST for action port [ 630.271115] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b85fbdb-5945-4de0-aa08-043822483a8a with Priority: HIGHEST for action port [ 630.271657] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b85fbdb-5945-4de0-aa08-043822483a8a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.271837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b85fbdb-5945-4de0-aa08-043822483a8a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.272019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b85fbdb-5945-4de0-aa08-043822483a8a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.273324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b85fbdb-5945-4de0-aa08-043822483a8a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.273376] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b85fbdb-5945-4de0-aa08-043822483a8a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.346181] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 999bc882-5526-4fb9-ad46-b6a148548e82 [ 630.346442] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.347395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.347395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.347820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.347902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.348027] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:999bc882-5526-4fb9-ad46-b6a148548e82 already deleted. [ 630.348124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-999bc882-5526-4fb9-ad46-b6a148548e82" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.777883] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3b85fbdb-5945-4de0-aa08-043822483a8a [ 630.778169] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.778304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.778376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.778579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.778668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.778761] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3b85fbdb-5945-4de0-aa08-043822483a8a already deleted. [ 630.778842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b85fbdb-5945-4de0-aa08-043822483a8a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.121836] env[69647]: INFO networking_nsxv3.common.synchronization [None req-e374aba3-ff40-4f64-be7c-9aad6ed1e46b None None] Enqueued Resource ID: ed2d9825-3349-493d-997a-94842edef3a3 with Priority: HIGHEST for action port [ 631.122514] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed2d9825-3349-493d-997a-94842edef3a3 with Priority: HIGHEST for action port [ 631.122842] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed2d9825-3349-493d-997a-94842edef3a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.122990] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed2d9825-3349-493d-997a-94842edef3a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.123098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed2d9825-3349-493d-997a-94842edef3a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.123393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed2d9825-3349-493d-997a-94842edef3a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.123479] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed2d9825-3349-493d-997a-94842edef3a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.571110] env[69647]: INFO networking_nsxv3.common.synchronization [None req-0fddd580-dff9-4d6f-a6d8-b54485eeaa3d None None] Enqueued Resource ID: ecfb147d-f055-4357-b1b8-630a1e6093be with Priority: HIGHEST for action port [ 631.571396] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecfb147d-f055-4357-b1b8-630a1e6093be with Priority: HIGHEST for action port [ 631.571968] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecfb147d-f055-4357-b1b8-630a1e6093be taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.572120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecfb147d-f055-4357-b1b8-630a1e6093be" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.572228] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecfb147d-f055-4357-b1b8-630a1e6093be" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.572447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecfb147d-f055-4357-b1b8-630a1e6093be" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.572529] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecfb147d-f055-4357-b1b8-630a1e6093be',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.625642] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed2d9825-3349-493d-997a-94842edef3a3 [ 631.625865] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.625983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.626064] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.626290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.626373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.626467] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed2d9825-3349-493d-997a-94842edef3a3 already deleted. [ 631.626542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed2d9825-3349-493d-997a-94842edef3a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.082018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecfb147d-f055-4357-b1b8-630a1e6093be [ 632.082018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.082018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.082018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.082018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.082018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.082018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecfb147d-f055-4357-b1b8-630a1e6093be already deleted. [ 632.082018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecfb147d-f055-4357-b1b8-630a1e6093be" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.224503] env[69647]: INFO networking_nsxv3.common.synchronization [None req-9e38968a-9eba-4afc-909e-adc2c0413e67 None None] Enqueued Resource ID: 3ff0b5a9-0c85-4d6f-a0d5-7676276e4c7c with Priority: HIGHEST for action port [ 632.224503] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ff0b5a9-0c85-4d6f-a0d5-7676276e4c7c with Priority: HIGHEST for action port [ 632.224814] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ff0b5a9-0c85-4d6f-a0d5-7676276e4c7c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.224906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ff0b5a9-0c85-4d6f-a0d5-7676276e4c7c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.225452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ff0b5a9-0c85-4d6f-a0d5-7676276e4c7c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.225452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ff0b5a9-0c85-4d6f-a0d5-7676276e4c7c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.225452] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ff0b5a9-0c85-4d6f-a0d5-7676276e4c7c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.727863] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ff0b5a9-0c85-4d6f-a0d5-7676276e4c7c [ 632.728406] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.728406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.728406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.728567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.728567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.728665] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ff0b5a9-0c85-4d6f-a0d5-7676276e4c7c already deleted. [ 632.728725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ff0b5a9-0c85-4d6f-a0d5-7676276e4c7c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.521403] env[69647]: INFO networking_nsxv3.common.synchronization [None req-400ba90b-5dfc-400a-b09f-59d7e5bb846b None None] Enqueued Resource ID: 33e1d74c-d724-476f-9ba6-2d51c4b5f599 with Priority: HIGHEST for action port [ 633.521403] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e1d74c-d724-476f-9ba6-2d51c4b5f599 with Priority: HIGHEST for action port [ 633.522042] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-33e1d74c-d724-476f-9ba6-2d51c4b5f599 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.522042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33e1d74c-d724-476f-9ba6-2d51c4b5f599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.522042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33e1d74c-d724-476f-9ba6-2d51c4b5f599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.522042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33e1d74c-d724-476f-9ba6-2d51c4b5f599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.523168] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33e1d74c-d724-476f-9ba6-2d51c4b5f599',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.948086] env[69647]: INFO networking_nsxv3.common.synchronization [None req-cf61d826-342b-4d28-bef8-f1f12d2b08c7 None None] Enqueued Resource ID: a8851d1c-2823-4464-98e5-052f3e18615f with Priority: HIGHEST for action port [ 633.948086] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8851d1c-2823-4464-98e5-052f3e18615f with Priority: HIGHEST for action port [ 633.948992] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8851d1c-2823-4464-98e5-052f3e18615f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.948992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8851d1c-2823-4464-98e5-052f3e18615f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.948992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8851d1c-2823-4464-98e5-052f3e18615f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.948992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8851d1c-2823-4464-98e5-052f3e18615f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.948992] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8851d1c-2823-4464-98e5-052f3e18615f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.014618] env[69647]: INFO networking_nsxv3.common.synchronization [None req-ca74183b-d903-4758-9a8a-9cd6396c0bf2 None None] Enqueued Resource ID: 1cd2ea7d-cb7e-428d-be21-8f7ac9b9e3ee with Priority: HIGHEST for action port [ 634.014618] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd2ea7d-cb7e-428d-be21-8f7ac9b9e3ee with Priority: HIGHEST for action port [ 634.014901] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cd2ea7d-cb7e-428d-be21-8f7ac9b9e3ee taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.015207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cd2ea7d-cb7e-428d-be21-8f7ac9b9e3ee" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.015207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cd2ea7d-cb7e-428d-be21-8f7ac9b9e3ee" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.015352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cd2ea7d-cb7e-428d-be21-8f7ac9b9e3ee" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.015435] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cd2ea7d-cb7e-428d-be21-8f7ac9b9e3ee',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.027395] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33e1d74c-d724-476f-9ba6-2d51c4b5f599 [ 634.027395] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.027395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.027395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.027395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.027395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.027395] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33e1d74c-d724-476f-9ba6-2d51c4b5f599 already deleted. [ 634.027395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33e1d74c-d724-476f-9ba6-2d51c4b5f599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.456779] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8851d1c-2823-4464-98e5-052f3e18615f [ 634.457018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.457159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.457229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.457440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.457526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.457617] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8851d1c-2823-4464-98e5-052f3e18615f already deleted. [ 634.457695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8851d1c-2823-4464-98e5-052f3e18615f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.523477] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cd2ea7d-cb7e-428d-be21-8f7ac9b9e3ee [ 634.523703] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.523834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.523903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.524262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.524359] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cd2ea7d-cb7e-428d-be21-8f7ac9b9e3ee already deleted. [ 634.524439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cd2ea7d-cb7e-428d-be21-8f7ac9b9e3ee" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.136697] env[69647]: INFO networking_nsxv3.common.synchronization [None req-4f8f87f9-8207-4e63-aaae-460ab1877270 None None] Enqueued Resource ID: cbee82f5-f446-40a3-b00f-2d324e185995 with Priority: HIGHEST for action port [ 635.136697] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbee82f5-f446-40a3-b00f-2d324e185995 with Priority: HIGHEST for action port [ 635.136697] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbee82f5-f446-40a3-b00f-2d324e185995 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.136697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbee82f5-f446-40a3-b00f-2d324e185995" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.136697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbee82f5-f446-40a3-b00f-2d324e185995" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.136697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbee82f5-f446-40a3-b00f-2d324e185995" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.136697] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbee82f5-f446-40a3-b00f-2d324e185995',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.639193] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbee82f5-f446-40a3-b00f-2d324e185995 [ 635.639455] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.639681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.639681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.639923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.640029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.640206] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbee82f5-f446-40a3-b00f-2d324e185995 already deleted. [ 635.641041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbee82f5-f446-40a3-b00f-2d324e185995" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.201488] env[69647]: INFO networking_nsxv3.common.synchronization [None req-0d2e5470-023a-4062-9e84-7e3c693e2a87 None None] Enqueued Resource ID: eaf77c99-5a47-4740-a1c8-48184b13694b with Priority: HIGHEST for action port [ 636.201488] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaf77c99-5a47-4740-a1c8-48184b13694b with Priority: HIGHEST for action port [ 636.201488] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-eaf77c99-5a47-4740-a1c8-48184b13694b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.201966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eaf77c99-5a47-4740-a1c8-48184b13694b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.201966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eaf77c99-5a47-4740-a1c8-48184b13694b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.201966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eaf77c99-5a47-4740-a1c8-48184b13694b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.201966] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaf77c99-5a47-4740-a1c8-48184b13694b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.569522] env[69647]: INFO networking_nsxv3.common.synchronization [req-a96b3ab0-5c95-463d-ae65-d24066819740 req-00cd4f51-cd10-41e1-ad61-51173ede2c25 tempest-FloatingIPsAssociationTestJSON-597742564 tempest-FloatingIPsAssociationTestJSON-597742564-project-member] Enqueued Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 636.570271] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 636.570894] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.571378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.571378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.571523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.572092] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.572092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.572092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.572092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.572092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.572365] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.697318] env[69647]: INFO networking_nsxv3.common.synchronization [None req-27cdd1aa-0c85-4ec0-888d-62b0d6f2075d None None] Enqueued Resource ID: c358b84e-966d-474f-ac7d-f315f866952c with Priority: HIGHEST for action port [ 636.697830] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c358b84e-966d-474f-ac7d-f315f866952c with Priority: HIGHEST for action port [ 636.698139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c358b84e-966d-474f-ac7d-f315f866952c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.698259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c358b84e-966d-474f-ac7d-f315f866952c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.698325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c358b84e-966d-474f-ac7d-f315f866952c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.698661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c358b84e-966d-474f-ac7d-f315f866952c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.698661] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c358b84e-966d-474f-ac7d-f315f866952c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.704238] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eaf77c99-5a47-4740-a1c8-48184b13694b [ 636.704313] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.704434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.704646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.704696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.705072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.705072] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eaf77c99-5a47-4740-a1c8-48184b13694b already deleted. [ 636.705072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eaf77c99-5a47-4740-a1c8-48184b13694b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.074423] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.074589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.074634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.075210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.075210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.075210] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.075210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.075483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.075483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.075483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.075567] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b already deleted. [ 637.076312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.207077] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c358b84e-966d-474f-ac7d-f315f866952c [ 637.207543] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.207543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.207543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.207543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.207696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.207724] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c358b84e-966d-474f-ac7d-f315f866952c already deleted. [ 637.207809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c358b84e-966d-474f-ac7d-f315f866952c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.033224] env[69647]: INFO networking_nsxv3.common.synchronization [None req-a5431772-6d4a-4118-835c-dbe67316f885 None None] Enqueued Resource ID: 327ba364-8fc7-406e-8bc6-da87b50aa1c2 with Priority: HIGHEST for action port [ 638.033678] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327ba364-8fc7-406e-8bc6-da87b50aa1c2 with Priority: HIGHEST for action port [ 638.033933] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-327ba364-8fc7-406e-8bc6-da87b50aa1c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.034081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-327ba364-8fc7-406e-8bc6-da87b50aa1c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.034147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-327ba364-8fc7-406e-8bc6-da87b50aa1c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.034405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-327ba364-8fc7-406e-8bc6-da87b50aa1c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.034483] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('327ba364-8fc7-406e-8bc6-da87b50aa1c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.545079] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 327ba364-8fc7-406e-8bc6-da87b50aa1c2 [ 638.545079] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.545079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.545079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.545079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.545079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.545079] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:327ba364-8fc7-406e-8bc6-da87b50aa1c2 already deleted. [ 638.545079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-327ba364-8fc7-406e-8bc6-da87b50aa1c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.715397] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-730 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.715636] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-730" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.715792] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-730" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.716184] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-730" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.716457] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.718417] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.718417] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.718417] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.718417] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.718417] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.718417] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.718417] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.718417] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.718417] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.718417] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.718417] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.738043] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.740604] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 638.740604] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.740604] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-730" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.740604] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-5298487e-914a-4a05-8469-0cdcffa5ac93 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.740604] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-5298487e-914a-4a05-8469-0cdcffa5ac93" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.740604] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-5298487e-914a-4a05-8469-0cdcffa5ac93" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.740604] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-5298487e-914a-4a05-8469-0cdcffa5ac93" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.740604] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5298487e-914a-4a05-8469-0cdcffa5ac93',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.200644] env[69647]: INFO networking_nsxv3.common.synchronization [req-3fcaf1ec-0aa2-4d72-87ae-ce80b62933df req-0a28d48b-6a70-4308-bc79-1b115a7b01de tempest-TenantUsagesTestJSON-268528473 tempest-TenantUsagesTestJSON-268528473-project-member] Enqueued Resource ID: b246b972-14ce-476e-a89c-fdca6030a597 with Priority: HIGHEST for action security_group_members [ 639.200644] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b246b972-14ce-476e-a89c-fdca6030a597 with Priority: HIGHEST for action security_group_members [ 639.200784] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b246b972-14ce-476e-a89c-fdca6030a597 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.200939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.201048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.201515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.201618] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.201730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.201773] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.202054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.202054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.202117] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b246b972-14ce-476e-a89c-fdca6030a597',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.242486] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.242718] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.243527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.243527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.244235] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.244235] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 5298487e-914a-4a05-8469-0cdcffa5ac93 not found, creating... [ 639.244235] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.244818] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.244818] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.244818] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.244818] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.246099] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.246099] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.246099] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.246099] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.246099] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.246301] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 5298487e-914a-4a05-8469-0cdcffa5ac93 is going to be created. [ 639.268995] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.271823] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.271823] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.271823] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.271823] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.271823] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-5298487e-914a-4a05-8469-0cdcffa5ac93" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.427117] env[69647]: INFO networking_nsxv3.common.synchronization [None req-774d2c4b-2abd-48c1-9fa8-145a4d2fcbd0 None None] Enqueued Resource ID: 0568b047-e2cd-484f-a89f-c36ee0e1fa91 with Priority: HIGHEST for action port [ 639.427117] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0568b047-e2cd-484f-a89f-c36ee0e1fa91 with Priority: HIGHEST for action port [ 639.427117] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-0568b047-e2cd-484f-a89f-c36ee0e1fa91 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.427117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0568b047-e2cd-484f-a89f-c36ee0e1fa91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.427117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0568b047-e2cd-484f-a89f-c36ee0e1fa91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.427117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0568b047-e2cd-484f-a89f-c36ee0e1fa91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.427117] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0568b047-e2cd-484f-a89f-c36ee0e1fa91',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.704538] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.705045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.705045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.705045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.705696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.705696] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.705696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.705696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.705696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.705696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.705964] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b246b972-14ce-476e-a89c-fdca6030a597 already deleted. [ 639.705964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.917425] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.917621] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.917810] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.918096] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.918409] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.918619] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.918680] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.918924] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.919453] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.919749] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.919861] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.919960] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.920079] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.920195] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.920395] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.920594] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.929680] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0568b047-e2cd-484f-a89f-c36ee0e1fa91 [ 639.930462] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.930462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.930462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.930769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.930769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.930769] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0568b047-e2cd-484f-a89f-c36ee0e1fa91 already deleted. [ 639.930769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0568b047-e2cd-484f-a89f-c36ee0e1fa91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.939151] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.939151] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 639.939151] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.939151] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.939442] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-ac6dba31-cce1-4ef6-898f-8caf294d8a5f taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.939517] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-ac6dba31-cce1-4ef6-898f-8caf294d8a5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.939662] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-ac6dba31-cce1-4ef6-898f-8caf294d8a5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.940337] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-ac6dba31-cce1-4ef6-898f-8caf294d8a5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.940504] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac6dba31-cce1-4ef6-898f-8caf294d8a5f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.447054] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.447054] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.447054] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.447054] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.447054] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.447054] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port ac6dba31-cce1-4ef6-898f-8caf294d8a5f not found, creating... [ 640.447054] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.447054] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.447054] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.447054] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.447054] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.447421] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.447421] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.447421] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.448544] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.448544] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.448678] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: ac6dba31-cce1-4ef6-898f-8caf294d8a5f is going to be created. [ 640.470553] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.470553] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.470553] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.470553] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.470553] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.470553] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-ac6dba31-cce1-4ef6-898f-8caf294d8a5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.650043] env[69647]: INFO networking_nsxv3.common.synchronization [None req-978c4bbd-1a39-4bd7-bc57-bf11f01851c0 None None] Enqueued Resource ID: 1ef1914c-2981-4b59-a170-7bfd21ec96d8 with Priority: HIGHEST for action port [ 640.650242] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ef1914c-2981-4b59-a170-7bfd21ec96d8 with Priority: HIGHEST for action port [ 640.652660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ef1914c-2981-4b59-a170-7bfd21ec96d8 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.654234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ef1914c-2981-4b59-a170-7bfd21ec96d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.654234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ef1914c-2981-4b59-a170-7bfd21ec96d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.654234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ef1914c-2981-4b59-a170-7bfd21ec96d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.654234] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ef1914c-2981-4b59-a170-7bfd21ec96d8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.823803] env[69647]: INFO networking_nsxv3.common.synchronization [req-a96b3ab0-5c95-463d-ae65-d24066819740 req-d8899879-fd2b-4fcf-9c64-d3d33fb79802 service nova] Enqueued Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_rules [ 640.824040] env[69647]: INFO networking_nsxv3.common.synchronization [req-a96b3ab0-5c95-463d-ae65-d24066819740 req-d8899879-fd2b-4fcf-9c64-d3d33fb79802 service nova] Enqueued Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 640.824040] env[69647]: INFO networking_nsxv3.common.synchronization [req-a96b3ab0-5c95-463d-ae65-d24066819740 req-d8899879-fd2b-4fcf-9c64-d3d33fb79802 service nova] Enqueued Resource ID: 5298487e-914a-4a05-8469-0cdcffa5ac93 with Priority: HIGHEST for action port [ 640.824263] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_rules [ 640.824406] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 640.824656] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5298487e-914a-4a05-8469-0cdcffa5ac93 with Priority: HIGHEST for action port [ 640.827835] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.827835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.827835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.827835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.827835] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.827835] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.827835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.827835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.827835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.827835] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.827835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.827835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.827835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.827835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.827835] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.828978] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-5298487e-914a-4a05-8469-0cdcffa5ac93 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.829913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5298487e-914a-4a05-8469-0cdcffa5ac93" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.830105] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5298487e-914a-4a05-8469-0cdcffa5ac93" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.830375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5298487e-914a-4a05-8469-0cdcffa5ac93" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.830538] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5298487e-914a-4a05-8469-0cdcffa5ac93',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.156774] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ef1914c-2981-4b59-a170-7bfd21ec96d8 [ 641.157340] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.157340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.157340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.157809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.157809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.157809] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ef1914c-2981-4b59-a170-7bfd21ec96d8 already deleted. [ 641.157809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ef1914c-2981-4b59-a170-7bfd21ec96d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.334082] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.334082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.343401] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.344348] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5298487e-914a-4a05-8469-0cdcffa5ac93 with status ACTIVE [ 641.344557] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.344683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.344752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.344954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.345087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.346110] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.346110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.346110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.346110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.346110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.346110] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.346110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.346110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.346110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.346982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.347152] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5298487e-914a-4a05-8469-0cdcffa5ac93 is going to be updated. [ 641.367650] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.367841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.367841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.368053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.368196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.368346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5298487e-914a-4a05-8469-0cdcffa5ac93" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.471420] env[69647]: INFO networking_nsxv3.common.synchronization [req-68d4325d-68ee-40f6-b9ac-218d223bf528 req-ff665083-8e29-4de4-b99f-f10a92640ee5 tempest-DeleteServersAdminTestJSON-1541525431 tempest-DeleteServersAdminTestJSON-1541525431-project-member] Enqueued Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 641.472009] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 641.472325] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.472452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.472553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.472765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.472923] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.473819] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.473952] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.474215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.475147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.475147] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.677009] env[69647]: INFO networking_nsxv3.common.synchronization [req-3fcaf1ec-0aa2-4d72-87ae-ce80b62933df req-204ce0a0-7db9-4e3c-9f8b-55806360a3c1 service nova] Enqueued Resource ID: b246b972-14ce-476e-a89c-fdca6030a597 with Priority: HIGHEST for action security_group_rules [ 641.677126] env[69647]: INFO networking_nsxv3.common.synchronization [req-3fcaf1ec-0aa2-4d72-87ae-ce80b62933df req-204ce0a0-7db9-4e3c-9f8b-55806360a3c1 service nova] Enqueued Resource ID: b246b972-14ce-476e-a89c-fdca6030a597 with Priority: HIGHEST for action security_group_members [ 641.677249] env[69647]: INFO networking_nsxv3.common.synchronization [req-3fcaf1ec-0aa2-4d72-87ae-ce80b62933df req-204ce0a0-7db9-4e3c-9f8b-55806360a3c1 service nova] Enqueued Resource ID: ac6dba31-cce1-4ef6-898f-8caf294d8a5f with Priority: HIGHEST for action port [ 641.677470] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b246b972-14ce-476e-a89c-fdca6030a597 with Priority: HIGHEST for action security_group_rules [ 641.677637] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b246b972-14ce-476e-a89c-fdca6030a597 with Priority: HIGHEST for action security_group_members [ 641.677739] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac6dba31-cce1-4ef6-898f-8caf294d8a5f with Priority: HIGHEST for action port [ 641.678848] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b246b972-14ce-476e-a89c-fdca6030a597 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.678848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.678848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.679139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.679244] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b246b972-14ce-476e-a89c-fdca6030a597',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.680169] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b246b972-14ce-476e-a89c-fdca6030a597 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.680533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.680533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.680640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.680824] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.680947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.681041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.681456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.681456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.681456] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b246b972-14ce-476e-a89c-fdca6030a597',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.682287] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac6dba31-cce1-4ef6-898f-8caf294d8a5f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.683285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac6dba31-cce1-4ef6-898f-8caf294d8a5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.683285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac6dba31-cce1-4ef6-898f-8caf294d8a5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.683285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac6dba31-cce1-4ef6-898f-8caf294d8a5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.683285] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac6dba31-cce1-4ef6-898f-8caf294d8a5f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.735796] env[69647]: INFO networking_nsxv3.common.synchronization [None req-8a3381f9-5fe5-45d1-928e-53d5404c4c1e tempest-VolumesAssistedSnapshotsTest-1240742357 tempest-VolumesAssistedSnapshotsTest-1240742357-project-member] Enqueued Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_rules [ 641.736389] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_rules [ 641.736885] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b392030a-efbc-48e0-a255-c920f33d1ae4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.736885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.736885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.737212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.737299] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.849050] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.979134] env[69647]: INFO networking_nsxv3.common.synchronization [None req-5dac11d7-248b-4e12-ae7e-ed7291d5e257 tempest-VolumesAssistedSnapshotsTest-1240742357 tempest-VolumesAssistedSnapshotsTest-1240742357-project-member] Enqueued Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_rules [ 641.979608] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.979608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.979608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.979761] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.979845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.980101] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.980190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.980190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.980351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.980530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.980530] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 already deleted. [ 641.980607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.982739] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_rules [ 641.982739] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b392030a-efbc-48e0-a255-c920f33d1ae4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.982739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.048322] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.048322] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.048322] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.049506] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.050538] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.051016] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.054028] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.054028] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.054028] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.054028] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 642.054028] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.054028] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.054028] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.054028] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 642.054028] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.054028] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.074098] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.074098] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 642.074098] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.074098] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.074098] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-e4c8acc4-41be-4bd4-82b1-79c2e7857be4 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.074098] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-e4c8acc4-41be-4bd4-82b1-79c2e7857be4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.074098] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-e4c8acc4-41be-4bd4-82b1-79c2e7857be4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.074098] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-e4c8acc4-41be-4bd4-82b1-79c2e7857be4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.074098] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4c8acc4-41be-4bd4-82b1-79c2e7857be4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.190623] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b246b972-14ce-476e-a89c-fdca6030a597 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.190623] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.190862] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b246b972-14ce-476e-a89c-fdca6030a597',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.192114] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac6dba31-cce1-4ef6-898f-8caf294d8a5f with status ACTIVE [ 642.192455] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.192675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.192804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.196331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.196331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.196331] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.196331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.196526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.198749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.198749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.198749] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.199009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.199043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.200321] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.200321] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.200321] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac6dba31-cce1-4ef6-898f-8caf294d8a5f is going to be updated. [ 642.227757] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.227897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.227954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.228254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.228387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.228550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac6dba31-cce1-4ef6-898f-8caf294d8a5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.269791] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.269791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.269791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.269791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.269791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.269791] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b392030a-efbc-48e0-a255-c920f33d1ae4 already deleted. [ 642.269791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.269791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.269791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.269791] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.353501] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.353624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.353624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.353870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.353951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.354066] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b is going to be created. [ 642.387749] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.387749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.387749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.387749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.387749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.397933] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: UNINITIALIZED for 2s [ 642.577186] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.577393] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.577519] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.577819] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.578020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.578108] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port e4c8acc4-41be-4bd4-82b1-79c2e7857be4 not found, creating... [ 642.578429] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.578570] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.578688] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.578909] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.579055] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.579414] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.579506] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.579601] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.579828] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.579987] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.580936] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: e4c8acc4-41be-4bd4-82b1-79c2e7857be4 is going to be created. [ 642.599522] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.599661] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.599780] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.600067] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.600384] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.600591] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-e4c8acc4-41be-4bd4-82b1-79c2e7857be4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.709260] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b246b972-14ce-476e-a89c-fdca6030a597',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.783581] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.784416] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.784416] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.784859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.785040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.785171] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b392030a-efbc-48e0-a255-c920f33d1ae4 already deleted. [ 642.785297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.932278] env[69647]: INFO networking_nsxv3.common.synchronization [None req-e306574e-ea56-49ce-9f8d-5c4000c22b2d None None] Enqueued Resource ID: 92e4e21a-6dc6-48b3-8992-a5fc41cde578 with Priority: HIGHEST for action port [ 642.932278] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e4e21a-6dc6-48b3-8992-a5fc41cde578 with Priority: HIGHEST for action port [ 642.932278] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-92e4e21a-6dc6-48b3-8992-a5fc41cde578 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.932278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92e4e21a-6dc6-48b3-8992-a5fc41cde578" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.932278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92e4e21a-6dc6-48b3-8992-a5fc41cde578" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.932278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92e4e21a-6dc6-48b3-8992-a5fc41cde578" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.932953] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92e4e21a-6dc6-48b3-8992-a5fc41cde578',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.012561] env[69647]: INFO networking_nsxv3.common.synchronization [req-01d0cead-842e-40fe-a0e2-8bc9ea383294 req-f87952b5-f83b-430d-abf5-a149e121376f tempest-ServersAdminNegativeTestJSON-19627888 tempest-ServersAdminNegativeTestJSON-19627888-project-member] Enqueued Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 643.013063] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 643.013358] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.013482] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.013549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.013784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.013933] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.014923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.014923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.014923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.014923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.014923] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.211791] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.211950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.212019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.212259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.212347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.212598] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b246b972-14ce-476e-a89c-fdca6030a597 is going to be created. [ 643.239661] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.239858] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.239936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.240876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.241081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.256989] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b246b972-14ce-476e-a89c-fdca6030a597 in Status: UNINITIALIZED for 2s [ 643.436227] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92e4e21a-6dc6-48b3-8992-a5fc41cde578 [ 643.436227] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.436227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.436227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.436227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.436227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.436227] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92e4e21a-6dc6-48b3-8992-a5fc41cde578 already deleted. [ 643.436227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92e4e21a-6dc6-48b3-8992-a5fc41cde578" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.519494] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.519494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.519494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.519494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.521792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.521792] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.521792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.521792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.521792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.521792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.521792] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9c01b37-5156-42f7-b415-81d83f30f935 already deleted. [ 643.521792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.742449] env[69647]: INFO networking_nsxv3.common.synchronization [req-68d4325d-68ee-40f6-b9ac-218d223bf528 req-158459c6-5bd2-4abb-b00a-9a3a3b2f06e3 service nova] Enqueued Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_rules [ 643.742665] env[69647]: INFO networking_nsxv3.common.synchronization [req-68d4325d-68ee-40f6-b9ac-218d223bf528 req-158459c6-5bd2-4abb-b00a-9a3a3b2f06e3 service nova] Enqueued Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 643.742756] env[69647]: INFO networking_nsxv3.common.synchronization [req-68d4325d-68ee-40f6-b9ac-218d223bf528 req-158459c6-5bd2-4abb-b00a-9a3a3b2f06e3 service nova] Enqueued Resource ID: e4c8acc4-41be-4bd4-82b1-79c2e7857be4 with Priority: HIGHEST for action port [ 643.742984] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_rules [ 643.743134] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 643.743233] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c8acc4-41be-4bd4-82b1-79c2e7857be4 with Priority: HIGHEST for action port [ 643.743775] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.743901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.743968] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.744512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.744638] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.746022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.746234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.750093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.750093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.750093] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.750093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.750093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.751487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.751487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.751487] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.752209] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4c8acc4-41be-4bd4-82b1-79c2e7857be4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.752439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4c8acc4-41be-4bd4-82b1-79c2e7857be4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.752439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4c8acc4-41be-4bd4-82b1-79c2e7857be4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.752939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4c8acc4-41be-4bd4-82b1-79c2e7857be4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.752939] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4c8acc4-41be-4bd4-82b1-79c2e7857be4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.774602] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.774806] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.775013] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.775308] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.776361] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.776361] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.776361] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.776361] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.776623] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.776906] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.776906] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.776906] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.777027] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.777115] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.777214] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.777339] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.796092] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.796243] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 643.797090] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.797346] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.797834] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1530f944-feb3-4d98-ab8b-2fd1f987eb3f taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.798228] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1530f944-feb3-4d98-ab8b-2fd1f987eb3f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.798378] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1530f944-feb3-4d98-ab8b-2fd1f987eb3f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.798751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1530f944-feb3-4d98-ab8b-2fd1f987eb3f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.798838] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1530f944-feb3-4d98-ab8b-2fd1f987eb3f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.254693] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.255016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.255182] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.256120] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4c8acc4-41be-4bd4-82b1-79c2e7857be4 with status ACTIVE [ 644.256309] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.256437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.256506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.256741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.256877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.257016] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.257199] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.257199] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.257325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.257402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.257582] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.257668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.257727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.257866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.257934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.258292] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4c8acc4-41be-4bd4-82b1-79c2e7857be4 is going to be updated. [ 644.277944] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.278105] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.278210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.278418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.280872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.280872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4c8acc4-41be-4bd4-82b1-79c2e7857be4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.301503] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.301918] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.301918] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.302123] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.302270] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.302455] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1530f944-feb3-4d98-ab8b-2fd1f987eb3f not found, creating... [ 644.302703] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.302965] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.303052] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.303220] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.303365] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.303785] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.303785] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.303925] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.304586] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.305041] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.305041] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1530f944-feb3-4d98-ab8b-2fd1f987eb3f is going to be created. [ 644.325587] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.325853] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.325934] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.326958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.326958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.326958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1530f944-feb3-4d98-ab8b-2fd1f987eb3f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.415851] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: SUCCESS [ 644.415851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.415851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.415851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.415851] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.415851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.415851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.415851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.415851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.415851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.415851] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.760951] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.918312] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.922034] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.922034] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.922034] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.922034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.922710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.922710] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.263507] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.263507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.263507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.263507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.263507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.263507] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 is going to be created. [ 645.275852] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b246b972-14ce-476e-a89c-fdca6030a597 in Status: SUCCESS [ 645.275852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.275852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.275852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.275852] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.275852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.275852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.275852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.275852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.275852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.275852] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b246b972-14ce-476e-a89c-fdca6030a597',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.308281] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.308281] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.308281] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.308281] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.308635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.318471] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: UNINITIALIZED for 2s [ 645.424632] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25192273-bc3e-4f3a-9543-1ed380b4ef9b: rpc.has_security_group_logging(os_id): False [ 645.444245] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.444358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.444440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.444657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.444749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.444953] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.445065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.445507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.445507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.445507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.445507] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.445929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.445929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.445929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.445929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.446202] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.446202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.446202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.446378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.446378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.446433] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b is going to be created. [ 645.511150] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.511307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.511454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.511698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.511902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.522705] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: IN_PROGRESS for 2s [ 645.622096] env[69647]: INFO networking_nsxv3.common.synchronization [req-01d0cead-842e-40fe-a0e2-8bc9ea383294 req-7650c170-f845-43bd-bff5-3147a1d4133e service nova] Enqueued Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_rules [ 645.622401] env[69647]: INFO networking_nsxv3.common.synchronization [req-01d0cead-842e-40fe-a0e2-8bc9ea383294 req-7650c170-f845-43bd-bff5-3147a1d4133e service nova] Enqueued Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 645.622553] env[69647]: INFO networking_nsxv3.common.synchronization [req-01d0cead-842e-40fe-a0e2-8bc9ea383294 req-7650c170-f845-43bd-bff5-3147a1d4133e service nova] Enqueued Resource ID: 1530f944-feb3-4d98-ab8b-2fd1f987eb3f with Priority: HIGHEST for action port [ 645.623504] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_rules [ 645.623678] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 645.623678] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1530f944-feb3-4d98-ab8b-2fd1f987eb3f with Priority: HIGHEST for action port [ 645.624162] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.624558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.624762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.625055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.625163] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.626902] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.627191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.627277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.627684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.627684] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.628229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.628229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.628597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.628739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.628803] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.633133] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1530f944-feb3-4d98-ab8b-2fd1f987eb3f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.633133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1530f944-feb3-4d98-ab8b-2fd1f987eb3f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.633133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1530f944-feb3-4d98-ab8b-2fd1f987eb3f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.633364] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1530f944-feb3-4d98-ab8b-2fd1f987eb3f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.633404] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1530f944-feb3-4d98-ab8b-2fd1f987eb3f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.781495] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b246b972-14ce-476e-a89c-fdca6030a597 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.781495] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.781495] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b246b972-14ce-476e-a89c-fdca6030a597 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.781495] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.781495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.782446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.782446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.782446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.782446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.782446] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b246b972-14ce-476e-a89c-fdca6030a597',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.138018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.138018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.138018] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.138018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1530f944-feb3-4d98-ab8b-2fd1f987eb3f with status ACTIVE [ 646.138018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.138018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.138018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.138018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.138018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.138018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.138018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.138018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.138018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.138018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.139570] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.139570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.139570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.140734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.140734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.140734] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1530f944-feb3-4d98-ab8b-2fd1f987eb3f is going to be updated. [ 646.181084] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.181289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.181384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.181874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.181874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.181874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1530f944-feb3-4d98-ab8b-2fd1f987eb3f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.284334] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b246b972-14ce-476e-a89c-fdca6030a597: rpc.has_security_group_logging(os_id): False [ 646.312312] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.312455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.312519] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.312816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.312935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.313169] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.313279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.313348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.313510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.313594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.313773] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.313867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.313930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.314084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.314160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.314361] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.314466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.314782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.314782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.314782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.314931] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b246b972-14ce-476e-a89c-fdca6030a597 is going to be created. [ 646.384090] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.384244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.384323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.384560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.385230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.397149] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b246b972-14ce-476e-a89c-fdca6030a597 in Status: IN_PROGRESS for 2s [ 646.596073] env[69647]: INFO networking_nsxv3.common.synchronization [req-fc7988a3-3188-4e14-bb20-a343ab63802d req-0ff4e830-1c71-4fa0-bca9-04659f189cbd tempest-ServerExternalEventsTest-1968853162 tempest-ServerExternalEventsTest-1968853162-project-member] Enqueued Resource ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 with Priority: HIGHEST for action security_group_members [ 646.596647] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 with Priority: HIGHEST for action security_group_members [ 646.596986] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.597633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.597720] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.598421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.598748] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.598867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.598867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.599245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.599344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.599431] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26d75834-c6a8-4d76-af3a-6cec3f2d79e2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.645019] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.102128] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.102529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.102723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.103027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.103209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.103568] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.103815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.103957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.104212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.104380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.104539] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 already deleted. [ 647.104813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.149542] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.149542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.149542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.149542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.149542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.149542] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9c01b37-5156-42f7-b415-81d83f30f935 is going to be created. [ 647.169101] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.172034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.172034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.172034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.172034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.179821] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: UNINITIALIZED for 2s [ 647.226025] env[69647]: INFO networking_nsxv3.common.synchronization [None req-b835093a-8268-4cf6-9ba6-35b99b213965 tempest-ServersWithSpecificFlavorTestJSON-1052584011 tempest-ServersWithSpecificFlavorTestJSON-1052584011-project-member] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_rules [ 647.226025] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_rules [ 647.226025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.226025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.226025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.226025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.226025] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.327133] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: SUCCESS [ 647.327438] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.327510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.327752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.327949] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.328096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.328171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.328488] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.328594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.328695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.328807] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.533689] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: SUCCESS [ 647.534361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.635740] env[69647]: INFO networking_nsxv3.common.synchronization [None req-2431f32d-4a91-4ff3-9926-de4ee6b5c333 tempest-ServersWithSpecificFlavorTestJSON-1052584011 tempest-ServersWithSpecificFlavorTestJSON-1052584011-project-member] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_rules [ 647.635740] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_rules [ 647.635740] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.635740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.749253] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.749253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.749253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.749253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.749253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.749253] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f already deleted. [ 647.749253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.749253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.749253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.749253] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.826324] env[69647]: INFO networking_nsxv3.common.synchronization [None req-a5d22338-77b6-43a5-b3db-68272c6560bf None None] Enqueued Resource ID: 6110bfac-0253-4d14-8110-5d54fe9b8252 with Priority: HIGHEST for action port [ 647.829342] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6110bfac-0253-4d14-8110-5d54fe9b8252 with Priority: HIGHEST for action port [ 647.830076] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-6110bfac-0253-4d14-8110-5d54fe9b8252 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.832018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6110bfac-0253-4d14-8110-5d54fe9b8252" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.832018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6110bfac-0253-4d14-8110-5d54fe9b8252" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.832018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6110bfac-0253-4d14-8110-5d54fe9b8252" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.832018] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6110bfac-0253-4d14-8110-5d54fe9b8252',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.832018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.832018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.832018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.832412] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.832412] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.832412] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.832412] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.832548] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.832579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.832663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.832858] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.832944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.832980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.833110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.833519] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.833692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.833692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.833836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.833908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.834059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.834108] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.271082] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.271240] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.271240] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.271534] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.272308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.272308] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f already deleted. [ 648.272308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.279694] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ba1a575-1076-4cbd-abf8-8f53cf47afd8 req-0bbb0974-b9d6-45c1-97db-7ca207a694c9 tempest-FloatingIPsAssociationNegativeTestJSON-1852455983 tempest-FloatingIPsAssociationNegativeTestJSON-1852455983-project-member] Enqueued Resource ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 with Priority: HIGHEST for action security_group_members [ 648.279893] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 with Priority: HIGHEST for action security_group_members [ 648.280697] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.280697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.280697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.280697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.280896] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.280896] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.280973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.281531] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.281688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.281840] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92008a16-dbb6-4fa9-bbfd-5faf35617bb1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.336581] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6110bfac-0253-4d14-8110-5d54fe9b8252 [ 648.336581] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.336878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.336878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.337009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.337147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.337208] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6110bfac-0253-4d14-8110-5d54fe9b8252 already deleted. [ 648.337334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6110bfac-0253-4d14-8110-5d54fe9b8252" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.337644] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37805a80-67ab-4e0f-8bc6-d25e71e20586: rpc.has_security_group_logging(os_id): False [ 648.358799] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.358799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.358799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.358933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.359040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.359319] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.359436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.359506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.359652] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.359730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.359906] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.360009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.360075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.360224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.360298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.360562] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.360679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.360743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.360889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.360965] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.361710] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 is going to be created. [ 648.408174] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b246b972-14ce-476e-a89c-fdca6030a597 in Status: SUCCESS [ 648.408282] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.420703] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.420890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.420982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.421260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.421487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.431757] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: IN_PROGRESS for 2s [ 648.761552] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.761773] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.761889] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.762164] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.762719] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.762912] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.763055] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.763285] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.763430] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.763679] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.763769] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.763857] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.763969] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.764098] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.764201] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.764329] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.783356] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.783356] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.783356] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.783497] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.783730] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-946c3638-6e73-4505-b569-b6fe6902df6b taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.783892] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-946c3638-6e73-4505-b569-b6fe6902df6b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.784012] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-946c3638-6e73-4505-b569-b6fe6902df6b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.784341] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-946c3638-6e73-4505-b569-b6fe6902df6b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.784513] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('946c3638-6e73-4505-b569-b6fe6902df6b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.785689] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.785798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.785887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.786041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.786120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.786606] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.786669] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.786715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.786861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.786933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.787029] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 already deleted. [ 648.787109] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.190875] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: SUCCESS [ 649.191103] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.191494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.191549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.191809] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.191916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.191916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.192191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.192276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.192376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.192484] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.288915] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.290143] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.290143] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.290304] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.290455] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.290601] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 946c3638-6e73-4505-b569-b6fe6902df6b not found, creating... [ 649.290828] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.291671] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.292375] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.292495] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.292649] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.292983] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.293157] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.293269] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.293478] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.293604] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.293759] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 946c3638-6e73-4505-b569-b6fe6902df6b is going to be created. [ 649.314845] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.315111] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.315293] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.315474] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.315703] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.315942] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-946c3638-6e73-4505-b569-b6fe6902df6b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.695277] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.695628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.695628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.695702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.696170] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.696170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.696170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.696170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.699126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.699126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.699126] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.699126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.699126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.699126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.699126] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.699126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.699126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.699126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.699126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.699126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.699126] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.704407] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.705705] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-845" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.705891] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-845" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.706288] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-845" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.706555] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.706712] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.708069] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.709181] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.709181] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.709181] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.709181] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.709181] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.709453] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.710032] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 649.710032] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.714549] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.733408] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.733408] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 649.733408] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.733408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-845" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.733408] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-845883b0-34a5-4cbd-ac91-22535a0a76a8 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.733408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-845883b0-34a5-4cbd-ac91-22535a0a76a8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.733408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-845883b0-34a5-4cbd-ac91-22535a0a76a8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.733408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-845883b0-34a5-4cbd-ac91-22535a0a76a8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.733408] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('845883b0-34a5-4cbd-ac91-22535a0a76a8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.750691] env[69647]: INFO networking_nsxv3.common.synchronization [None req-9fdfacfc-f247-4676-af4f-f81dc4ba434d None None] Enqueued Resource ID: fc426166-76c3-4033-aae9-cbb5783b4d27 with Priority: HIGHEST for action port [ 649.750691] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc426166-76c3-4033-aae9-cbb5783b4d27 with Priority: HIGHEST for action port [ 649.750691] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc426166-76c3-4033-aae9-cbb5783b4d27 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.750691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc426166-76c3-4033-aae9-cbb5783b4d27" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.750691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc426166-76c3-4033-aae9-cbb5783b4d27" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.750691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc426166-76c3-4033-aae9-cbb5783b4d27" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.750691] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc426166-76c3-4033-aae9-cbb5783b4d27',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.179287] env[69647]: INFO networking_nsxv3.common.synchronization [None req-e6dd19d9-6686-40a2-bafe-589ff8ea0e1f None None] Enqueued Resource ID: 518808a0-d067-4458-b186-253a37bc7eb7 with Priority: HIGHEST for action port [ 650.179542] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518808a0-d067-4458-b186-253a37bc7eb7 with Priority: HIGHEST for action port [ 650.180346] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-518808a0-d067-4458-b186-253a37bc7eb7 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.180651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-518808a0-d067-4458-b186-253a37bc7eb7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.180721] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-518808a0-d067-4458-b186-253a37bc7eb7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.181500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-518808a0-d067-4458-b186-253a37bc7eb7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.181500] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('518808a0-d067-4458-b186-253a37bc7eb7',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.204037] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9c01b37-5156-42f7-b415-81d83f30f935: rpc.has_security_group_logging(os_id): False [ 650.222102] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.222284] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.222352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.222768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.222845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.223075] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.223200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.223363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.223501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.223501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.223777] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.223777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.223777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.223926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.223966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.224241] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.224371] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.224498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.224661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.224734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.224831] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9c01b37-5156-42f7-b415-81d83f30f935 is going to be created. [ 650.237341] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.238033] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.238326] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.239224] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.239224] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.239224] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 845883b0-34a5-4cbd-ac91-22535a0a76a8 not found, creating... [ 650.239616] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.239712] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.239748] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.240073] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.240378] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.240471] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.240640] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.240762] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.241461] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.241568] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.241811] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 845883b0-34a5-4cbd-ac91-22535a0a76a8 is going to be created. [ 650.252331] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc426166-76c3-4033-aae9-cbb5783b4d27 [ 650.252904] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.253138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.253342] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.253619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.253758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.253809] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc426166-76c3-4033-aae9-cbb5783b4d27 already deleted. [ 650.253906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc426166-76c3-4033-aae9-cbb5783b4d27" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.259881] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.260101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.260223] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.260529] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.260716] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.261213] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-845883b0-34a5-4cbd-ac91-22535a0a76a8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.287956] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.288093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.288093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.288536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.288536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.303777] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: IN_PROGRESS for 2s [ 650.363110] env[69647]: INFO networking_nsxv3.common.synchronization [req-45542dfd-ba83-4ec5-931a-1661331c7cc9 req-c8382f43-4f41-496a-a84d-f673b9c362a6 tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 650.363110] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 650.363110] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.363110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.363110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.363110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.363110] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.363110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.363110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.363110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.363110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.363110] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.445577] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: SUCCESS [ 650.445805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.685144] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 518808a0-d067-4458-b186-253a37bc7eb7 [ 650.685358] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.685437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.685533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.685852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.686069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.686196] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:518808a0-d067-4458-b186-253a37bc7eb7 already deleted. [ 650.686330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-518808a0-d067-4458-b186-253a37bc7eb7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.868514] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.868514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.868514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.868514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.868514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.868514] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.868514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.868514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.868514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.868514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.868514] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 already deleted. [ 650.868514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.961804] env[69647]: INFO networking_nsxv3.common.synchronization [None req-66a384e7-0c99-47fd-861a-0b452dc2504e None None] Enqueued Resource ID: f0fd033f-3755-4769-a668-05abf238de24 with Priority: HIGHEST for action port [ 650.961804] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0fd033f-3755-4769-a668-05abf238de24 with Priority: HIGHEST for action port [ 650.961804] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0fd033f-3755-4769-a668-05abf238de24 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.962667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0fd033f-3755-4769-a668-05abf238de24" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.962667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0fd033f-3755-4769-a668-05abf238de24" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.962667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0fd033f-3755-4769-a668-05abf238de24" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.962667] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0fd033f-3755-4769-a668-05abf238de24',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.033946] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.035142] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.035323] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.036306] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.036753] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.037449] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.037578] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.037827] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.038011] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.038317] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.038558] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.038690] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.039205] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.039205] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.039308] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.039496] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.059959] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.067026] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 651.067026] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.067026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.067026] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-6fb22df0-7039-41df-bf28-e2f04aec82d2 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.067026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-6fb22df0-7039-41df-bf28-e2f04aec82d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.067026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-6fb22df0-7039-41df-bf28-e2f04aec82d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.067026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-6fb22df0-7039-41df-bf28-e2f04aec82d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.067026] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fb22df0-7039-41df-bf28-e2f04aec82d2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.307311] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ba1a575-1076-4cbd-abf8-8f53cf47afd8 req-79e87687-4b5c-4c26-8d00-d83c54b36294 service nova] Enqueued Resource ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 with Priority: HIGHEST for action security_group_rules [ 651.307724] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ba1a575-1076-4cbd-abf8-8f53cf47afd8 req-79e87687-4b5c-4c26-8d00-d83c54b36294 service nova] Enqueued Resource ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 with Priority: HIGHEST for action security_group_members [ 651.307724] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ba1a575-1076-4cbd-abf8-8f53cf47afd8 req-79e87687-4b5c-4c26-8d00-d83c54b36294 service nova] Enqueued Resource ID: 845883b0-34a5-4cbd-ac91-22535a0a76a8 with Priority: HIGHEST for action port [ 651.309504] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 with Priority: HIGHEST for action security_group_rules [ 651.309504] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 with Priority: HIGHEST for action security_group_members [ 651.309504] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 845883b0-34a5-4cbd-ac91-22535a0a76a8 with Priority: HIGHEST for action port [ 651.309504] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92008a16-dbb6-4fa9-bbfd-5faf35617bb1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.309649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.309649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.311070] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.311070] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92008a16-dbb6-4fa9-bbfd-5faf35617bb1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.311447] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.311532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.311566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.312699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.312699] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.312699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.312699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.312699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.316072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.316181] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92008a16-dbb6-4fa9-bbfd-5faf35617bb1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.319465] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-845883b0-34a5-4cbd-ac91-22535a0a76a8 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.319659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-845883b0-34a5-4cbd-ac91-22535a0a76a8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.319659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-845883b0-34a5-4cbd-ac91-22535a0a76a8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.323089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-845883b0-34a5-4cbd-ac91-22535a0a76a8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.323089] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('845883b0-34a5-4cbd-ac91-22535a0a76a8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.467444] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0fd033f-3755-4769-a668-05abf238de24 [ 651.467752] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.467898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.467964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.468191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.468300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.468556] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0fd033f-3755-4769-a668-05abf238de24 already deleted. [ 651.468667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0fd033f-3755-4769-a668-05abf238de24" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.572321] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.572321] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.572321] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.572321] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.572321] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.572321] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 6fb22df0-7039-41df-bf28-e2f04aec82d2 not found, creating... [ 651.572321] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.572321] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.572321] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.572321] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.572321] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.572749] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.573058] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.573363] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.573798] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.574087] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.574341] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 6fb22df0-7039-41df-bf28-e2f04aec82d2 is going to be created. [ 651.600588] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.600588] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.600588] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.600588] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.600588] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.600588] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-6fb22df0-7039-41df-bf28-e2f04aec82d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.694882] env[69647]: INFO networking_nsxv3.common.synchronization [req-fc7988a3-3188-4e14-bb20-a343ab63802d req-f209552b-4b34-4b5d-8193-6aa75036e19e service nova] Enqueued Resource ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 with Priority: HIGHEST for action security_group_rules [ 651.695130] env[69647]: INFO networking_nsxv3.common.synchronization [req-fc7988a3-3188-4e14-bb20-a343ab63802d req-f209552b-4b34-4b5d-8193-6aa75036e19e service nova] Enqueued Resource ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 with Priority: HIGHEST for action security_group_members [ 651.695475] env[69647]: INFO networking_nsxv3.common.synchronization [req-fc7988a3-3188-4e14-bb20-a343ab63802d req-f209552b-4b34-4b5d-8193-6aa75036e19e service nova] Enqueued Resource ID: 946c3638-6e73-4505-b569-b6fe6902df6b with Priority: HIGHEST for action port [ 651.695895] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 with Priority: HIGHEST for action security_group_rules [ 651.700146] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 with Priority: HIGHEST for action security_group_members [ 651.700497] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 946c3638-6e73-4505-b569-b6fe6902df6b with Priority: HIGHEST for action port [ 651.700775] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26d75834-c6a8-4d76-af3a-6cec3f2d79e2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.700918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.700989] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.701299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.701410] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26d75834-c6a8-4d76-af3a-6cec3f2d79e2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.702888] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.702888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.703025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.703201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.703278] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.703389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.703449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.703606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.703690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.703922] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26d75834-c6a8-4d76-af3a-6cec3f2d79e2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.705479] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-946c3638-6e73-4505-b569-b6fe6902df6b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.705479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-946c3638-6e73-4505-b569-b6fe6902df6b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.705479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-946c3638-6e73-4505-b569-b6fe6902df6b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.705709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-946c3638-6e73-4505-b569-b6fe6902df6b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.705794] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('946c3638-6e73-4505-b569-b6fe6902df6b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.820653] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92008a16-dbb6-4fa9-bbfd-5faf35617bb1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.821827] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.821948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.829473] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 845883b0-34a5-4cbd-ac91-22535a0a76a8 with status ACTIVE [ 651.830753] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.830753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.830753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.830753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.830753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.831106] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.831341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.831420] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.835454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.835454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.835454] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.835454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.835454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.835454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.835454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.835454] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 845883b0-34a5-4cbd-ac91-22535a0a76a8 is going to be updated. [ 651.858296] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.858296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.858296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.858615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.858677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.858908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-845883b0-34a5-4cbd-ac91-22535a0a76a8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.947126] env[69647]: INFO networking_nsxv3.common.synchronization [None req-2aeec27f-7feb-443f-b623-3d01607df8bb None None] Enqueued Resource ID: acc22451-7ed7-4c9f-9961-99d95063be21 with Priority: HIGHEST for action port [ 651.947126] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acc22451-7ed7-4c9f-9961-99d95063be21 with Priority: HIGHEST for action port [ 651.947126] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-acc22451-7ed7-4c9f-9961-99d95063be21 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.949346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acc22451-7ed7-4c9f-9961-99d95063be21" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.949346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acc22451-7ed7-4c9f-9961-99d95063be21" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.949346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acc22451-7ed7-4c9f-9961-99d95063be21" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.949346] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc22451-7ed7-4c9f-9961-99d95063be21',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.208865] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26d75834-c6a8-4d76-af3a-6cec3f2d79e2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.211661] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.211661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.211661] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 946c3638-6e73-4505-b569-b6fe6902df6b with status ACTIVE [ 652.211661] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.211995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.211995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.211995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.212267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.212267] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.212470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.213109] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.213331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.216812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.216812] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.216812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.216812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.216812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.216812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.217201] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 946c3638-6e73-4505-b569-b6fe6902df6b is going to be updated. [ 652.241697] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.241697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.241697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.241697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.241697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.241697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-946c3638-6e73-4505-b569-b6fe6902df6b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.317037] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: SUCCESS [ 652.317307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.323739] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92008a16-dbb6-4fa9-bbfd-5faf35617bb1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.412848] env[69647]: INFO networking_nsxv3.common.synchronization [req-45542dfd-ba83-4ec5-931a-1661331c7cc9 req-8121f15c-b03a-4eb1-9ff6-d814a0b9e918 service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 652.412895] env[69647]: INFO networking_nsxv3.common.synchronization [req-45542dfd-ba83-4ec5-931a-1661331c7cc9 req-8121f15c-b03a-4eb1-9ff6-d814a0b9e918 service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 652.413186] env[69647]: INFO networking_nsxv3.common.synchronization [req-45542dfd-ba83-4ec5-931a-1661331c7cc9 req-8121f15c-b03a-4eb1-9ff6-d814a0b9e918 service nova] Enqueued Resource ID: 6fb22df0-7039-41df-bf28-e2f04aec82d2 with Priority: HIGHEST for action port [ 652.413265] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 652.413374] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 652.413470] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fb22df0-7039-41df-bf28-e2f04aec82d2 with Priority: HIGHEST for action port [ 652.414076] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.414208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.414271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.414532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.414613] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.416702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.416702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.416702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.416702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.416702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.416702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.416702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.416702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.416702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.416702] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.417424] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fb22df0-7039-41df-bf28-e2f04aec82d2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.417424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fb22df0-7039-41df-bf28-e2f04aec82d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.417424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fb22df0-7039-41df-bf28-e2f04aec82d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.417841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fb22df0-7039-41df-bf28-e2f04aec82d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.417841] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fb22df0-7039-41df-bf28-e2f04aec82d2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.451600] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acc22451-7ed7-4c9f-9961-99d95063be21 [ 652.451600] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.451600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.451600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.451831] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.451831] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.451831] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acc22451-7ed7-4c9f-9961-99d95063be21 already deleted. [ 652.451912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acc22451-7ed7-4c9f-9961-99d95063be21" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.631491] env[69647]: INFO networking_nsxv3.common.synchronization [None req-739dc5da-9a8e-4f7e-814e-b3008e3fa407 None None] Enqueued Resource ID: 1311d97f-f51f-4b75-a1cd-ac95f319f160 with Priority: HIGHEST for action port [ 652.632088] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1311d97f-f51f-4b75-a1cd-ac95f319f160 with Priority: HIGHEST for action port [ 652.632424] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1311d97f-f51f-4b75-a1cd-ac95f319f160 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.632724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1311d97f-f51f-4b75-a1cd-ac95f319f160" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.632724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1311d97f-f51f-4b75-a1cd-ac95f319f160" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.632993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1311d97f-f51f-4b75-a1cd-ac95f319f160" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.633338] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1311d97f-f51f-4b75-a1cd-ac95f319f160',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.711960] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26d75834-c6a8-4d76-af3a-6cec3f2d79e2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.828905] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.829436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.830068] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.830068] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.830068] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.830068] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 is going to be created. [ 652.851220] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.851371] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.851500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.851850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.852026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.860939] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 in Status: UNINITIALIZED for 2s [ 652.898859] env[69647]: INFO networking_nsxv3.common.synchronization [req-c0fe2993-5cca-458b-85ad-5d3f7b67b989 req-b239786a-ebab-4574-be1e-fd37c5ddf994 tempest-VolumesAssistedSnapshotsTest-1240742357 tempest-VolumesAssistedSnapshotsTest-1240742357-project-member] Enqueued Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_members [ 652.899383] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_members [ 652.899685] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b392030a-efbc-48e0-a255-c920f33d1ae4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.899812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.899872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.900128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.900324] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.900459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.900510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.900648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.900793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.900836] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.920775] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.921924] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.921924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.922456] env[69647]: INFO networking_nsxv3.common.synchronization [None req-f4a1fbbd-2c4f-45c1-a89c-af00592e1351 None None] Enqueued Resource ID: c5880f14-2d40-4cae-8491-09f64e66fcc9 with Priority: HIGHEST for action port [ 652.922715] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fb22df0-7039-41df-bf28-e2f04aec82d2 with status ACTIVE [ 652.922872] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.923621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.923734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.923968] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.924070] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.924244] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.924341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.924685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.924854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.925602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.925602] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.925602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.925602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.925602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.925602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.925926] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fb22df0-7039-41df-bf28-e2f04aec82d2 is going to be updated. [ 652.929220] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5880f14-2d40-4cae-8491-09f64e66fcc9 with Priority: HIGHEST for action port [ 652.930360] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5880f14-2d40-4cae-8491-09f64e66fcc9 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.930571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5880f14-2d40-4cae-8491-09f64e66fcc9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.930699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5880f14-2d40-4cae-8491-09f64e66fcc9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.930954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5880f14-2d40-4cae-8491-09f64e66fcc9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.931054] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5880f14-2d40-4cae-8491-09f64e66fcc9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.950123] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.950123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.950123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.950790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.950790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.950790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fb22df0-7039-41df-bf28-e2f04aec82d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.137238] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1311d97f-f51f-4b75-a1cd-ac95f319f160 [ 653.137475] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.137609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.137679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.137890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.137971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.138092] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1311d97f-f51f-4b75-a1cd-ac95f319f160 already deleted. [ 653.138154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1311d97f-f51f-4b75-a1cd-ac95f319f160" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.215799] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.215945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.216083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.216329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.216453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.216610] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 is going to be created. [ 653.252970] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.253450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.253581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.253989] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.254266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.266206] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 in Status: UNINITIALIZED for 2s [ 653.403055] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.403245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.403316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.403537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.403625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.403829] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.403925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.403987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.404233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.404233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.404319] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b392030a-efbc-48e0-a255-c920f33d1ae4 already deleted. [ 653.404408] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.431027] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.436210] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5880f14-2d40-4cae-8491-09f64e66fcc9 [ 653.436210] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.436210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.436210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.436537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.436537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.436656] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5880f14-2d40-4cae-8491-09f64e66fcc9 already deleted. [ 653.436689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5880f14-2d40-4cae-8491-09f64e66fcc9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.905635] env[69647]: INFO networking_nsxv3.common.synchronization [None req-cb9ff890-4688-4eba-8516-bd00348ca168 None None] Enqueued Resource ID: 87cd1d31-9532-42c2-894b-f5148aea1d06 with Priority: HIGHEST for action port [ 653.906888] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87cd1d31-9532-42c2-894b-f5148aea1d06 with Priority: HIGHEST for action port [ 653.906888] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-87cd1d31-9532-42c2-894b-f5148aea1d06 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.906888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87cd1d31-9532-42c2-894b-f5148aea1d06" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.906888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87cd1d31-9532-42c2-894b-f5148aea1d06" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.907381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87cd1d31-9532-42c2-894b-f5148aea1d06" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.907505] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87cd1d31-9532-42c2-894b-f5148aea1d06',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.935241] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.935361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.935690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.935956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.937045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.937045] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be created. [ 653.959009] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.959315] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.959315] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.959660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.959660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.970760] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: UNINITIALIZED for 2s [ 654.146433] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.146775] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.146775] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.147116] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.147381] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.147547] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.147655] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.147882] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.148222] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.148505] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.148646] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.148739] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.148857] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.148976] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.149096] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.149232] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.167428] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.167428] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 654.167609] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.167609] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.168027] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.168140] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.169072] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.169072] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.169072] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.413139] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87cd1d31-9532-42c2-894b-f5148aea1d06 [ 654.413139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.413139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.413139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.413139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.413139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.413139] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87cd1d31-9532-42c2-894b-f5148aea1d06 already deleted. [ 654.413139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87cd1d31-9532-42c2-894b-f5148aea1d06" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.672264] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.674215] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.674215] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.674215] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.674215] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.674215] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67 not found, creating... [ 654.674367] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.676101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.676101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.676101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.676101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.676101] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.676101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.676101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.676101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.676101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.676101] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67 is going to be created. [ 654.696392] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.696392] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.696392] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.696392] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.696392] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.696392] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.870970] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 in Status: SUCCESS [ 654.870970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.870970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.870970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.870970] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.871217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.871217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.871323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.871403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.871493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.871600] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92008a16-dbb6-4fa9-bbfd-5faf35617bb1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.278251] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 in Status: SUCCESS [ 655.280218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.280218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.280218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.280816] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.280816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.280816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.281074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.281074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.281074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.281563] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26d75834-c6a8-4d76-af3a-6cec3f2d79e2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.378021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.378021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.378021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.378021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.378021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.379265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.379265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.379265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.379265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.379265] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92008a16-dbb6-4fa9-bbfd-5faf35617bb1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.628691] env[69647]: INFO networking_nsxv3.common.synchronization [None req-c77cff83-3755-4b85-b50d-efd94135df52 None None] Enqueued Resource ID: 3d5035a4-acf7-4f43-a5a6-0e6cf69fbf3e with Priority: HIGHEST for action port [ 655.630239] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d5035a4-acf7-4f43-a5a6-0e6cf69fbf3e with Priority: HIGHEST for action port [ 655.630386] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d5035a4-acf7-4f43-a5a6-0e6cf69fbf3e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.631915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d5035a4-acf7-4f43-a5a6-0e6cf69fbf3e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.631915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d5035a4-acf7-4f43-a5a6-0e6cf69fbf3e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.631915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d5035a4-acf7-4f43-a5a6-0e6cf69fbf3e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.631915] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d5035a4-acf7-4f43-a5a6-0e6cf69fbf3e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.743554] env[69647]: INFO networking_nsxv3.common.synchronization [None req-1e902df4-d69b-4d6e-9ccf-2180562fbffe None None] Enqueued Resource ID: 72518da3-bc12-4ab1-994d-75152f8c23d2 with Priority: HIGHEST for action port [ 655.744966] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72518da3-bc12-4ab1-994d-75152f8c23d2 with Priority: HIGHEST for action port [ 655.745985] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-72518da3-bc12-4ab1-994d-75152f8c23d2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.746755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72518da3-bc12-4ab1-994d-75152f8c23d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.747017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72518da3-bc12-4ab1-994d-75152f8c23d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.747361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72518da3-bc12-4ab1-994d-75152f8c23d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.747628] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72518da3-bc12-4ab1-994d-75152f8c23d2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.785927] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.786109] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.786177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.786390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.786566] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.786649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.786737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.786854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.786934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.787029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.787166] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.787253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.787310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.787481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.787595] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.787686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.787744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.787875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.787945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.788032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.788116] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26d75834-c6a8-4d76-af3a-6cec3f2d79e2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.813140] env[69647]: INFO networking_nsxv3.common.synchronization [req-c0fe2993-5cca-458b-85ad-5d3f7b67b989 req-faa12c68-6a93-4315-baf6-e3ef27246b16 service nova] Enqueued Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_rules [ 655.813460] env[69647]: INFO networking_nsxv3.common.synchronization [req-c0fe2993-5cca-458b-85ad-5d3f7b67b989 req-faa12c68-6a93-4315-baf6-e3ef27246b16 service nova] Enqueued Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_members [ 655.813592] env[69647]: INFO networking_nsxv3.common.synchronization [req-c0fe2993-5cca-458b-85ad-5d3f7b67b989 req-faa12c68-6a93-4315-baf6-e3ef27246b16 service nova] Enqueued Resource ID: 1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67 with Priority: HIGHEST for action port [ 655.814918] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_rules [ 655.815113] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_members [ 655.816932] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67 with Priority: HIGHEST for action port [ 655.816932] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b392030a-efbc-48e0-a255-c920f33d1ae4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.816932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.816932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.816932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.816932] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.817354] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b392030a-efbc-48e0-a255-c920f33d1ae4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.817493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.817692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.817981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.818154] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.818279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.818361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.818558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.818666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.818782] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.820076] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.820226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.820311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.820690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.820690] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.884094] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92008a16-dbb6-4fa9-bbfd-5faf35617bb1: rpc.has_security_group_logging(os_id): False [ 655.901844] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.902062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.902145] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.902402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.902519] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.902795] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.902913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.902995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.903244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.903341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.903597] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.903708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.903744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.903933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.904327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.904327] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.904327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.904564] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.904609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.904738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.904789] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 is going to be created. [ 655.964587] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.964587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.964587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.965110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.965110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.978526] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 in Status: IN_PROGRESS for 2s [ 655.978668] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 655.978859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.979027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.979232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.979418] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.979531] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.979656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.979794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.983069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.983069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.983069] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.134059] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d5035a4-acf7-4f43-a5a6-0e6cf69fbf3e [ 656.134322] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.134450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.134551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.134745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.134859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.134972] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d5035a4-acf7-4f43-a5a6-0e6cf69fbf3e already deleted. [ 656.135076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d5035a4-acf7-4f43-a5a6-0e6cf69fbf3e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.250143] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72518da3-bc12-4ab1-994d-75152f8c23d2 [ 656.250377] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.250538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.250612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.250856] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.250925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.251043] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72518da3-bc12-4ab1-994d-75152f8c23d2 already deleted. [ 656.251137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72518da3-bc12-4ab1-994d-75152f8c23d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.294626] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26d75834-c6a8-4d76-af3a-6cec3f2d79e2: rpc.has_security_group_logging(os_id): False [ 656.311254] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.311363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.311436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.311644] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.311905] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.311969] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.312065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.312121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.312276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.312350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.312524] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.312673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.312673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.312815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.312872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.313054] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.313150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.313209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.313347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.313422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.313510] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 is going to be created. [ 656.322166] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.323101] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b392030a-efbc-48e0-a255-c920f33d1ae4 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.323212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.323633] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67 with status ACTIVE [ 656.323707] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.323813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.323862] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.324072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.324113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.324285] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.324374] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.324436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.324579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.324611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.324786] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.324880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.324942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.325120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.325229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.325259] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67 is going to be updated. [ 656.342059] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.342207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.342408] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.342486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.342586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.342813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dfa7162-50fd-4c0f-a1b3-f1ca7a17ac67" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.369367] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.369467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.369544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.369762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.369942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.388983] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 in Status: IN_PROGRESS for 2s [ 656.485665] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.485833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.485833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.486047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.486176] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.486272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.486328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.486480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.486566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.486653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.486789] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.487066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.487066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.487191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.487244] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.487326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.487381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.487572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.487572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.487698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.487698] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.823996] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.989658] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 326bee86-2025-4239-98be-95f9262ac7a3: rpc.has_security_group_logging(os_id): False [ 657.011849] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.011933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.012033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.012482] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.012530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.017035] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.017035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.017035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.017035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.017035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.017035] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.017035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.017035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.017035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.017035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.017035] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.017035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.017035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.017035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.018235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.018235] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be created. [ 657.089972] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.090106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.090150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.090359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.090630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.103275] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 657.327806] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.328140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.328140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.328284] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.328373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.328482] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b392030a-efbc-48e0-a255-c920f33d1ae4 is going to be created. [ 657.352561] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.352762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.352823] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.353057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.353194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.362684] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b392030a-efbc-48e0-a255-c920f33d1ae4 in Status: UNINITIALIZED for 2s [ 657.990602] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 in Status: SUCCESS [ 657.990937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.401982] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 in Status: SUCCESS [ 658.401982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.432606] env[69647]: INFO networking_nsxv3.common.synchronization [req-20f0473e-95cc-4e76-95fb-acdae84c73d0 req-89811e24-7ea5-4cdd-a948-a293bee4304f tempest-SecurityGroupRulesTestJSON-1339677363 tempest-SecurityGroupRulesTestJSON-1339677363-project-member] Enqueued Resource ID: 67f8da43-8f2d-414a-920c-1d8ca07ffa2f with Priority: HIGHEST for action security_group_rules [ 658.432606] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f8da43-8f2d-414a-920c-1d8ca07ffa2f with Priority: HIGHEST for action security_group_rules [ 658.432606] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67f8da43-8f2d-414a-920c-1d8ca07ffa2f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.432606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67f8da43-8f2d-414a-920c-1d8ca07ffa2f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.432606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67f8da43-8f2d-414a-920c-1d8ca07ffa2f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.432606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67f8da43-8f2d-414a-920c-1d8ca07ffa2f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.432606] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67f8da43-8f2d-414a-920c-1d8ca07ffa2f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.951115] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.951272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.951272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.951465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.951740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.951740] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67f8da43-8f2d-414a-920c-1d8ca07ffa2f already deleted. [ 658.951740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67f8da43-8f2d-414a-920c-1d8ca07ffa2f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.117501] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 659.117733] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.368470] env[69647]: INFO networking_nsxv3.common.synchronization [req-baf94a3f-0396-4bbb-82ff-537a92d0c777 req-efeea9b0-67ec-4a72-8a86-af181c06c258 tempest-ServerDiagnosticsNegativeTest-99990549 tempest-ServerDiagnosticsNegativeTest-99990549-project-member] Enqueued Resource ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f with Priority: HIGHEST for action security_group_members [ 659.369083] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f with Priority: HIGHEST for action security_group_members [ 659.369477] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.369659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.369727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.369989] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.371812] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.371951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.372025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.372581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.372581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.372581] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2e36bcf-78c7-4f7b-8f47-dd80eafb244f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.375560] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b392030a-efbc-48e0-a255-c920f33d1ae4 in Status: SUCCESS [ 659.375700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.377231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.377428] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.377620] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.377727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.377788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.378492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.378492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.378492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.378492] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.880799] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.881662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.882765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.883132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.885528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.885528] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.885528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.885528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.885528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.885528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.885528] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f already deleted. [ 659.885528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.885528] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.951388] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.951675] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.951812] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.952094] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.952365] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.952527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.952644] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.952867] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.953018] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.956569] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.956698] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.956823] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.956990] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.957128] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.957238] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.957374] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.983802] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.983960] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.984112] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.984287] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.984596] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-cd625294-db7b-4a55-88a9-800f6f6cd9d3 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.984771] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-cd625294-db7b-4a55-88a9-800f6f6cd9d3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.984890] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-cd625294-db7b-4a55-88a9-800f6f6cd9d3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.985240] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-cd625294-db7b-4a55-88a9-800f6f6cd9d3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.985368] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd625294-db7b-4a55-88a9-800f6f6cd9d3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.180065] env[69647]: INFO networking_nsxv3.common.synchronization [req-e4a3613b-1f75-4a66-8586-5838314b84c6 req-66e945d4-427b-4258-9e53-58662185cbad tempest-SecurityGroupRulesTestJSON-1339677363 tempest-SecurityGroupRulesTestJSON-1339677363-project-member] Enqueued Resource ID: 55a00621-a598-4290-b016-6971297db6ac with Priority: HIGHEST for action security_group_rules [ 660.180797] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a00621-a598-4290-b016-6971297db6ac with Priority: HIGHEST for action security_group_rules [ 660.181324] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55a00621-a598-4290-b016-6971297db6ac taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.181577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55a00621-a598-4290-b016-6971297db6ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.182464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55a00621-a598-4290-b016-6971297db6ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.182464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55a00621-a598-4290-b016-6971297db6ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.182464] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55a00621-a598-4290-b016-6971297db6ac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.389758] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b392030a-efbc-48e0-a255-c920f33d1ae4: rpc.has_security_group_logging(os_id): False [ 660.410219] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.410219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.410219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.410219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.410219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.410219] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.410219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.410219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.410219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.410219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.410219] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b392030a-efbc-48e0-a255-c920f33d1ae4 is going to be created. [ 660.481459] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.482144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.482144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.482144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.482438] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.490163] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.490163] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.490163] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.490163] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.490163] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.490163] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port cd625294-db7b-4a55-88a9-800f6f6cd9d3 not found, creating... [ 660.490393] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.490493] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.491668] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.491668] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.491668] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.491668] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.491668] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.491668] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.491982] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.491982] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.492079] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: cd625294-db7b-4a55-88a9-800f6f6cd9d3 is going to be created. [ 660.493919] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b392030a-efbc-48e0-a255-c920f33d1ae4 in Status: IN_PROGRESS for 2s [ 660.516903] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.516903] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.516903] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.516903] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.516903] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.516903] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-cd625294-db7b-4a55-88a9-800f6f6cd9d3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.714345] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.715773] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.716672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.716672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.716672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.716672] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55a00621-a598-4290-b016-6971297db6ac already deleted. [ 660.716672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55a00621-a598-4290-b016-6971297db6ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.254682] env[69647]: INFO networking_nsxv3.common.synchronization [req-30005782-ba66-410b-9175-cfa3e405891b req-6b17c897-74c5-48d7-a8ce-8827a0188f88 tempest-DeleteServersAdminTestJSON-1449850368 tempest-DeleteServersAdminTestJSON-1449850368-project-admin] Enqueued Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 661.255307] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 661.255610] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.256561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.256561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.256561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.256561] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.256561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.256561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.257049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.257049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.257049] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.556177] env[69647]: INFO networking_nsxv3.common.synchronization [req-ebcc3bd9-12c5-4838-bf3c-a691353403d1 req-80b08d0f-208d-4219-acb8-3c43268749cd tempest-ServerDiagnosticsTest-1196137100 tempest-ServerDiagnosticsTest-1196137100-project-member] Enqueued Resource ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b with Priority: HIGHEST for action security_group_members [ 661.556687] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b with Priority: HIGHEST for action security_group_members [ 661.557050] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-67fa0349-fc9a-4525-98b6-98f14f9e267b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.557197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.557273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.557534] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.558877] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.559119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.559119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.559465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.559927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.560092] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67fa0349-fc9a-4525-98b6-98f14f9e267b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.736357] env[69647]: INFO networking_nsxv3.common.synchronization [req-baf94a3f-0396-4bbb-82ff-537a92d0c777 req-16b3d567-c620-457c-a060-9a0854fa7330 service nova] Enqueued Resource ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f with Priority: HIGHEST for action security_group_rules [ 661.736357] env[69647]: INFO networking_nsxv3.common.synchronization [req-baf94a3f-0396-4bbb-82ff-537a92d0c777 req-16b3d567-c620-457c-a060-9a0854fa7330 service nova] Enqueued Resource ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f with Priority: HIGHEST for action security_group_members [ 661.736357] env[69647]: INFO networking_nsxv3.common.synchronization [req-baf94a3f-0396-4bbb-82ff-537a92d0c777 req-16b3d567-c620-457c-a060-9a0854fa7330 service nova] Enqueued Resource ID: cd625294-db7b-4a55-88a9-800f6f6cd9d3 with Priority: HIGHEST for action port [ 661.736576] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f with Priority: HIGHEST for action security_group_rules [ 661.736699] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f with Priority: HIGHEST for action security_group_members [ 661.736793] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd625294-db7b-4a55-88a9-800f6f6cd9d3 with Priority: HIGHEST for action port [ 661.739255] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.743022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.743022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.743022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.743022] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2e36bcf-78c7-4f7b-8f47-dd80eafb244f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.743022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.743022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.743022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.743022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.743022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.743022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.743022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.743022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.743022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.743022] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2e36bcf-78c7-4f7b-8f47-dd80eafb244f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.747536] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd625294-db7b-4a55-88a9-800f6f6cd9d3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.747900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd625294-db7b-4a55-88a9-800f6f6cd9d3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.749034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd625294-db7b-4a55-88a9-800f6f6cd9d3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.749341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd625294-db7b-4a55-88a9-800f6f6cd9d3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.750208] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd625294-db7b-4a55-88a9-800f6f6cd9d3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.759030] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.759030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.759233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.759437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.759437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.761091] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.761091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.761091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.761091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.761091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.761091] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 is going to be updated. [ 661.796367] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.796538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.796613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.796822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.796981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.806966] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: IN_PROGRESS for 2s [ 662.062487] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.062668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.062740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.062950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.063052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.063261] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.063404] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.064779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.064779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.064779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.064779] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b already deleted. [ 662.064779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.252592] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2e36bcf-78c7-4f7b-8f47-dd80eafb244f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.253744] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.253843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.254037] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd625294-db7b-4a55-88a9-800f6f6cd9d3 with status ACTIVE [ 662.254334] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.254334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.254424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.254569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.254658] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.254822] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.255058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.255058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.255137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.255246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.255396] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.255491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.255553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.255748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.255748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.255941] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd625294-db7b-4a55-88a9-800f6f6cd9d3 is going to be updated. [ 662.278669] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.279039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.279039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.279131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.279271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.279468] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd625294-db7b-4a55-88a9-800f6f6cd9d3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.283676] env[69647]: INFO networking_nsxv3.common.synchronization [req-3a578506-289e-4cb4-b184-86b4e34f0d8a req-5d861130-4231-4470-a000-1fc22bc5c555 tempest-TenantUsagesTestJSON-268528473 tempest-TenantUsagesTestJSON-268528473-project-member] Enqueued Resource ID: b246b972-14ce-476e-a89c-fdca6030a597 with Priority: HIGHEST for action security_group_members [ 662.283941] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b246b972-14ce-476e-a89c-fdca6030a597 with Priority: HIGHEST for action security_group_members [ 662.284470] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b246b972-14ce-476e-a89c-fdca6030a597 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.284600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.284681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.284866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.285024] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.285446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.285510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.285659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.285741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.285836] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b246b972-14ce-476e-a89c-fdca6030a597',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.343245] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.343420] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.343554] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.343838] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.344107] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.344262] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.344372] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.344579] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.344717] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.345558] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.345689] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.345823] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.345915] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.346038] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.346148] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.346283] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.372350] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.372522] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 662.372668] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.372848] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.373193] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-9119d86d-d68e-4d46-af9a-a2c302d76a95 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.373556] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-9119d86d-d68e-4d46-af9a-a2c302d76a95" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.373556] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-9119d86d-d68e-4d46-af9a-a2c302d76a95" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.373869] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-9119d86d-d68e-4d46-af9a-a2c302d76a95" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.374033] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9119d86d-d68e-4d46-af9a-a2c302d76a95',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.505675] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b392030a-efbc-48e0-a255-c920f33d1ae4 in Status: SUCCESS [ 662.505974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.760275] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2e36bcf-78c7-4f7b-8f47-dd80eafb244f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.788248] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.788446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.788492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.788696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.788790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.788980] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.789085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.789159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.789314] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.789391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.789480] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b246b972-14ce-476e-a89c-fdca6030a597 is going to be updated. [ 662.816403] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.816493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.816528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.817518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.817518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.825924] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b246b972-14ce-476e-a89c-fdca6030a597 in Status: IN_PROGRESS for 2s [ 662.877207] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.878278] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.878278] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.878278] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.878278] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.878647] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 9119d86d-d68e-4d46-af9a-a2c302d76a95 not found, creating... [ 662.878742] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.879761] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.879761] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.879761] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.879761] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.879761] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.880341] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.880341] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.880341] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.881154] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.881154] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 9119d86d-d68e-4d46-af9a-a2c302d76a95 is going to be created. [ 662.910255] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.910545] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.910693] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.910951] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.911187] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.911636] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-9119d86d-d68e-4d46-af9a-a2c302d76a95" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.266222] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.266222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.266222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.266222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.266222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.266222] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f is going to be created. [ 663.288626] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.288626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.288626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.288626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.288626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.298899] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f in Status: UNINITIALIZED for 2s [ 663.818263] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: SUCCESS [ 663.818263] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 deletion is rescheduled due to dependency. [ 663.818263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.827783] env[69647]: INFO networking_nsxv3.common.synchronization [req-ebcc3bd9-12c5-4838-bf3c-a691353403d1 req-0f2a852e-4413-42d2-a3b0-813eab60597b service nova] Enqueued Resource ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b with Priority: HIGHEST for action security_group_rules [ 663.828340] env[69647]: INFO networking_nsxv3.common.synchronization [req-ebcc3bd9-12c5-4838-bf3c-a691353403d1 req-0f2a852e-4413-42d2-a3b0-813eab60597b service nova] Enqueued Resource ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b with Priority: HIGHEST for action security_group_members [ 663.829925] env[69647]: INFO networking_nsxv3.common.synchronization [req-ebcc3bd9-12c5-4838-bf3c-a691353403d1 req-0f2a852e-4413-42d2-a3b0-813eab60597b service nova] Enqueued Resource ID: 9119d86d-d68e-4d46-af9a-a2c302d76a95 with Priority: HIGHEST for action port [ 663.829925] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b with Priority: HIGHEST for action security_group_rules [ 663.829925] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b with Priority: HIGHEST for action security_group_members [ 663.829925] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9119d86d-d68e-4d46-af9a-a2c302d76a95 with Priority: HIGHEST for action port [ 663.833865] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67fa0349-fc9a-4525-98b6-98f14f9e267b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.833865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.833865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.833865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.833865] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67fa0349-fc9a-4525-98b6-98f14f9e267b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.833865] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-67fa0349-fc9a-4525-98b6-98f14f9e267b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.833865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.833865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.833865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.833865] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.833865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.833865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.833865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.833865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.833865] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67fa0349-fc9a-4525-98b6-98f14f9e267b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.840048] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-9119d86d-d68e-4d46-af9a-a2c302d76a95 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.840048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9119d86d-d68e-4d46-af9a-a2c302d76a95" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.840048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9119d86d-d68e-4d46-af9a-a2c302d76a95" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.840048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9119d86d-d68e-4d46-af9a-a2c302d76a95" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.840048] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9119d86d-d68e-4d46-af9a-a2c302d76a95',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.340762] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67fa0349-fc9a-4525-98b6-98f14f9e267b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.342434] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-67fa0349-fc9a-4525-98b6-98f14f9e267b taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.342549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.342937] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9119d86d-d68e-4d46-af9a-a2c302d76a95 with status ACTIVE [ 664.343127] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.343239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.343304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.343505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.343597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.343765] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.343858] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.343918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.344079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.344155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.344337] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.344429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.344489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.344629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.344701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.344781] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9119d86d-d68e-4d46-af9a-a2c302d76a95 is going to be updated. [ 664.366132] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.366132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.366132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.366132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.366132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.366132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9119d86d-d68e-4d46-af9a-a2c302d76a95" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.392605] env[69647]: INFO networking_nsxv3.common.synchronization [req-32eec1b8-ad15-497d-81b9-1dbe65f7e519 req-75e2c85e-5ff2-41f5-a76e-5fed7f038fd2 tempest-ServersWithSpecificFlavorTestJSON-1052584011 tempest-ServersWithSpecificFlavorTestJSON-1052584011-project-member] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 664.392772] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 664.393085] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.393205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.393268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.393524] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.393676] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.393774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.393833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.394743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.394836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.394935] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.835490] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b246b972-14ce-476e-a89c-fdca6030a597 in Status: SUCCESS [ 664.835490] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b246b972-14ce-476e-a89c-fdca6030a597 deletion is rescheduled due to dependency. [ 664.835490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.844760] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67fa0349-fc9a-4525-98b6-98f14f9e267b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.897955] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.897955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.897955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.897955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.897955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.897955] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.897955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.897955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.897955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.897955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.897955] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f already deleted. [ 664.897955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.959370] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.959370] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-692" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.959370] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-692" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.959370] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-692" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.959370] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.959370] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.960155] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.961078] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.961370] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.961864] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.962123] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.962367] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.964242] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.964242] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.964242] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.964242] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.981378] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.981573] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 664.981774] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.981984] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-692" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.982329] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-28aad9c4-d717-4459-8cce-be77fe27cb4d taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.982474] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-28aad9c4-d717-4459-8cce-be77fe27cb4d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.982593] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-28aad9c4-d717-4459-8cce-be77fe27cb4d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.982902] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-28aad9c4-d717-4459-8cce-be77fe27cb4d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.983521] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28aad9c4-d717-4459-8cce-be77fe27cb4d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.307209] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f in Status: SUCCESS [ 665.307384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.307737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.307934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.308147] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.308268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.308328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.308509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.308596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.308679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.308769] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2e36bcf-78c7-4f7b-8f47-dd80eafb244f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.347817] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.348154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.348154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.348263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.348609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.348718] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b is going to be created. [ 665.368608] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.368871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.368871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.369055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.369220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.377797] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b in Status: UNINITIALIZED for 2s [ 665.489347] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.489513] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.489607] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.489900] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.492539] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.492539] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 28aad9c4-d717-4459-8cce-be77fe27cb4d not found, creating... [ 665.492539] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.492539] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.492539] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.492539] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.492539] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.492539] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.492539] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.492539] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.496197] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.499039] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.499039] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 28aad9c4-d717-4459-8cce-be77fe27cb4d is going to be created. [ 665.518401] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.518401] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.518401] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.518401] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.518401] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.518401] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-28aad9c4-d717-4459-8cce-be77fe27cb4d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.811045] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.811208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.811279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.811513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.811728] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.811794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.811859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.812030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.812186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.812186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.812365] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.812430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.812548] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.812600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.812707] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.812816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.812962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.813078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.813180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.813224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.813308] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2e36bcf-78c7-4f7b-8f47-dd80eafb244f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.857817] env[69647]: INFO networking_nsxv3.common.synchronization [None req-3fa778c1-38b2-4d21-b8c6-a852a15fa600 None None] Enqueued Resource ID: 009da7d3-7616-489b-93e6-cb65841f5a20 with Priority: HIGHEST for action port [ 665.858111] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009da7d3-7616-489b-93e6-cb65841f5a20 with Priority: HIGHEST for action port [ 665.858685] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-009da7d3-7616-489b-93e6-cb65841f5a20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.858808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-009da7d3-7616-489b-93e6-cb65841f5a20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.858872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-009da7d3-7616-489b-93e6-cb65841f5a20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.859161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-009da7d3-7616-489b-93e6-cb65841f5a20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.859240] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('009da7d3-7616-489b-93e6-cb65841f5a20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.286769] env[69647]: INFO networking_nsxv3.common.synchronization [req-1e0ea1dd-26ba-42fc-af8f-d7d8174a18c0 req-55b5f5d1-c673-4a78-9a13-f03ad09627af tempest-SecurityGroupRulesTestJSON-1339677363 tempest-SecurityGroupRulesTestJSON-1339677363-project-member] Enqueued Resource ID: cf051ea8-13e2-41f6-bb67-82962ca2c460 with Priority: HIGHEST for action security_group_rules [ 666.287308] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf051ea8-13e2-41f6-bb67-82962ca2c460 with Priority: HIGHEST for action security_group_rules [ 666.287608] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf051ea8-13e2-41f6-bb67-82962ca2c460 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.287729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf051ea8-13e2-41f6-bb67-82962ca2c460" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.287798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf051ea8-13e2-41f6-bb67-82962ca2c460" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.289794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf051ea8-13e2-41f6-bb67-82962ca2c460" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.289794] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf051ea8-13e2-41f6-bb67-82962ca2c460',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.318110] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2e36bcf-78c7-4f7b-8f47-dd80eafb244f: rpc.has_security_group_logging(os_id): False [ 666.335822] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.335960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.336051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.336244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.336329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.336526] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.336619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.336682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.336828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.336905] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.337121] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.337218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.337280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.337420] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.337505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.337691] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.337807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.337869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.343266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.343446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.343552] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f is going to be created. [ 666.366012] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 009da7d3-7616-489b-93e6-cb65841f5a20 [ 666.366354] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.366467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.366565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.366840] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.366954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.367105] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:009da7d3-7616-489b-93e6-cb65841f5a20 already deleted. [ 666.367219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-009da7d3-7616-489b-93e6-cb65841f5a20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.403353] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.403530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.403572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.403787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.403953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.414771] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f in Status: IN_PROGRESS for 2s [ 666.472375] env[69647]: INFO networking_nsxv3.common.synchronization [req-2abc0991-1b5a-4be3-b25b-841e77dc6c6d req-7cf6f3da-2127-4ea6-9978-6555257cac39 tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 666.472896] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 666.473110] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.473236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.473305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.473603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.473935] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.474652] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.474652] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.474652] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.475008] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.475157] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.704442] env[69647]: INFO networking_nsxv3.common.synchronization [req-32eec1b8-ad15-497d-81b9-1dbe65f7e519 req-a6db57e7-65b5-410e-8f39-d36eea248137 service nova] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_rules [ 666.704660] env[69647]: INFO networking_nsxv3.common.synchronization [req-32eec1b8-ad15-497d-81b9-1dbe65f7e519 req-a6db57e7-65b5-410e-8f39-d36eea248137 service nova] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 666.705277] env[69647]: INFO networking_nsxv3.common.synchronization [req-32eec1b8-ad15-497d-81b9-1dbe65f7e519 req-a6db57e7-65b5-410e-8f39-d36eea248137 service nova] Enqueued Resource ID: 28aad9c4-d717-4459-8cce-be77fe27cb4d with Priority: HIGHEST for action port [ 666.705530] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_rules [ 666.705530] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 666.705629] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28aad9c4-d717-4459-8cce-be77fe27cb4d with Priority: HIGHEST for action port [ 666.705826] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.706165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.706257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.707274] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.707274] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.707869] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.707869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.707869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.711393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.711393] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.711611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.711611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.711681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.711749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.716748] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.718104] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-28aad9c4-d717-4459-8cce-be77fe27cb4d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.718204] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28aad9c4-d717-4459-8cce-be77fe27cb4d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.718255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28aad9c4-d717-4459-8cce-be77fe27cb4d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.718444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28aad9c4-d717-4459-8cce-be77fe27cb4d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.718719] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28aad9c4-d717-4459-8cce-be77fe27cb4d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.723023] env[69647]: INFO networking_nsxv3.common.synchronization [req-33979961-56fe-48b1-996c-a02da7f71984 req-12168433-3643-48f3-81ef-3159d4a34824 tempest-ImagesOneServerTestJSON-207396395 tempest-ImagesOneServerTestJSON-207396395-project-member] Enqueued Resource ID: dea7752c-71a7-48c6-ad69-e6c96549e90c with Priority: HIGHEST for action security_group_members [ 666.723933] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea7752c-71a7-48c6-ad69-e6c96549e90c with Priority: HIGHEST for action security_group_members [ 666.724016] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea7752c-71a7-48c6-ad69-e6c96549e90c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.724137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.724205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.725177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.725177] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.725177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.725177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.725177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.725177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.725177] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea7752c-71a7-48c6-ad69-e6c96549e90c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.809038] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.809191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.809264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.809477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.809559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.809651] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf051ea8-13e2-41f6-bb67-82962ca2c460 already deleted. [ 666.809773] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf051ea8-13e2-41f6-bb67-82962ca2c460" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.981513] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.981513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.981513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.981513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.981513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.981513] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.981513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.981513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.981513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.981513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.981513] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 667.018023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.018023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.018023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.018023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.018023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.024402] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 667.220785] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.222123] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.222268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.226103] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28aad9c4-d717-4459-8cce-be77fe27cb4d with status ACTIVE [ 667.226359] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.226520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.226606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.226843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.226900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.227093] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.227213] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.227278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.227454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.227529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.227719] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.227841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.227905] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.228066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.228158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.228247] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28aad9c4-d717-4459-8cce-be77fe27cb4d is going to be updated. [ 667.233351] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.233351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.233351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.233351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.233351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.233351] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.233351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.233351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.233351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.233351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.233351] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea7752c-71a7-48c6-ad69-e6c96549e90c already deleted. [ 667.233351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.255741] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.255741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.255741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.255741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.255741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.255741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28aad9c4-d717-4459-8cce-be77fe27cb4d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.391108] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b in Status: SUCCESS [ 667.391108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.391108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.391108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.391108] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.391108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.391108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.391108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.391108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.391108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.391108] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67fa0349-fc9a-4525-98b6-98f14f9e267b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.656701] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-144 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.657055] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-144" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.657354] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-144" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.657616] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-144" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.658032] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.658161] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.658299] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.659198] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.659198] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.659198] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.659198] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.659198] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.659401] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.659401] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.659501] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.659635] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.677058] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.677236] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 667.677415] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.677550] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-144" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.677878] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-4006cdf4-0520-444e-a405-b5c06042971f taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.678058] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-4006cdf4-0520-444e-a405-b5c06042971f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.678190] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-4006cdf4-0520-444e-a405-b5c06042971f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.678551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-4006cdf4-0520-444e-a405-b5c06042971f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.678689] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4006cdf4-0520-444e-a405-b5c06042971f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.724812] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.899857] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-67fa0349-fc9a-4525-98b6-98f14f9e267b taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.899857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.899857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.901582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.901582] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.901582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.901582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.901582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.901582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.901582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.906215] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-67fa0349-fc9a-4525-98b6-98f14f9e267b taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.906215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.906215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.906215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.906215] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.906215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.906215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.906215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.906215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.906215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.906215] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67fa0349-fc9a-4525-98b6-98f14f9e267b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.181800] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.181920] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.182112] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.182453] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.182644] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.182841] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 4006cdf4-0520-444e-a405-b5c06042971f not found, creating... [ 668.183163] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.183367] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.183503] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.183774] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.184260] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.184260] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.184451] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.184611] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.184821] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.185024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.185133] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 4006cdf4-0520-444e-a405-b5c06042971f is going to be created. [ 668.210061] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.210302] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.210411] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.210736] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.210976] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.211231] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-4006cdf4-0520-444e-a405-b5c06042971f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.228385] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.228567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.229014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.229014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.229014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.229174] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f is going to be created. [ 668.256421] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.256627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.256693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.256921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.257095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.267302] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: UNINITIALIZED for 2s [ 668.412824] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67fa0349-fc9a-4525-98b6-98f14f9e267b: rpc.has_security_group_logging(os_id): False [ 668.428283] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f in Status: SUCCESS [ 668.428522] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.430296] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.431099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.431099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.431099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.431099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.431099] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.431483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.431483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.431550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.431659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.434360] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.434360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.434360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.434360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.434360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.434360] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.434360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.434360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.434360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.434360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.434360] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b is going to be created. [ 668.486804] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.486804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.486804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.486804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.486804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.497226] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b in Status: IN_PROGRESS for 2s [ 669.034502] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 669.034502] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 deletion is rescheduled due to dependency. [ 669.034502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.072277] env[69647]: INFO networking_nsxv3.common.synchronization [None req-a69a3cd4-40ed-4a7f-9521-323b62b189e0 None None] Enqueued Resource ID: e9964323-2a06-4cc3-ac12-88db2d4d6d52 with Priority: HIGHEST for action port [ 669.072277] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9964323-2a06-4cc3-ac12-88db2d4d6d52 with Priority: HIGHEST for action port [ 669.072277] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9964323-2a06-4cc3-ac12-88db2d4d6d52 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.072277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9964323-2a06-4cc3-ac12-88db2d4d6d52" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.072277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9964323-2a06-4cc3-ac12-88db2d4d6d52" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.073077] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9964323-2a06-4cc3-ac12-88db2d4d6d52" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.073628] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9964323-2a06-4cc3-ac12-88db2d4d6d52',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.416217] env[69647]: INFO networking_nsxv3.common.synchronization [None req-f0796d2f-9c91-4117-99e1-7fc1ab8b7331 None None] Enqueued Resource ID: e9263eb1-63d1-4ed2-8f23-aa4fc0591f5f with Priority: HIGHEST for action port [ 669.416217] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9263eb1-63d1-4ed2-8f23-aa4fc0591f5f with Priority: HIGHEST for action port [ 669.416217] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9263eb1-63d1-4ed2-8f23-aa4fc0591f5f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.416217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9263eb1-63d1-4ed2-8f23-aa4fc0591f5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.416217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9263eb1-63d1-4ed2-8f23-aa4fc0591f5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.416791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9263eb1-63d1-4ed2-8f23-aa4fc0591f5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.416791] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9263eb1-63d1-4ed2-8f23-aa4fc0591f5f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.580268] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9964323-2a06-4cc3-ac12-88db2d4d6d52 [ 669.580769] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.580769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.580769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.580992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.580992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.581092] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9964323-2a06-4cc3-ac12-88db2d4d6d52 already deleted. [ 669.581135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9964323-2a06-4cc3-ac12-88db2d4d6d52" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.654950] env[69647]: INFO networking_nsxv3.common.synchronization [None req-ecdc074d-c448-4e79-911a-7b92bb9d663e None None] Enqueued Resource ID: 0312fae9-4e47-4e46-a2ba-9f72de121989 with Priority: HIGHEST for action port [ 669.655583] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0312fae9-4e47-4e46-a2ba-9f72de121989 with Priority: HIGHEST for action port [ 669.655778] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-0312fae9-4e47-4e46-a2ba-9f72de121989 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.655923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0312fae9-4e47-4e46-a2ba-9f72de121989" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.655994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0312fae9-4e47-4e46-a2ba-9f72de121989" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.657417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0312fae9-4e47-4e46-a2ba-9f72de121989" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.658062] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0312fae9-4e47-4e46-a2ba-9f72de121989',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.829285] env[69647]: INFO networking_nsxv3.common.synchronization [req-c6d81c6f-b13e-4ca1-946b-04db4df7248f req-fa0dd221-9d86-4f55-8529-49b72551e8cb tempest-ServerExternalEventsTest-1968853162 tempest-ServerExternalEventsTest-1968853162-project-member] Enqueued Resource ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 with Priority: HIGHEST for action security_group_members [ 669.832891] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 with Priority: HIGHEST for action security_group_members [ 669.833553] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.833742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.833742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.833948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.834162] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.834239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.834290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.834427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.834521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.834607] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26d75834-c6a8-4d76-af3a-6cec3f2d79e2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.921784] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9263eb1-63d1-4ed2-8f23-aa4fc0591f5f [ 669.922010] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.922146] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.922214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.922424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.922507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.923689] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9263eb1-63d1-4ed2-8f23-aa4fc0591f5f already deleted. [ 669.923689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9263eb1-63d1-4ed2-8f23-aa4fc0591f5f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.977432] env[69647]: INFO networking_nsxv3.common.synchronization [req-33979961-56fe-48b1-996c-a02da7f71984 req-d34b7d21-df96-4465-91c4-461d56b2d9bf service nova] Enqueued Resource ID: dea7752c-71a7-48c6-ad69-e6c96549e90c with Priority: HIGHEST for action security_group_rules [ 669.977432] env[69647]: INFO networking_nsxv3.common.synchronization [req-33979961-56fe-48b1-996c-a02da7f71984 req-d34b7d21-df96-4465-91c4-461d56b2d9bf service nova] Enqueued Resource ID: dea7752c-71a7-48c6-ad69-e6c96549e90c with Priority: HIGHEST for action security_group_members [ 669.977432] env[69647]: INFO networking_nsxv3.common.synchronization [req-33979961-56fe-48b1-996c-a02da7f71984 req-d34b7d21-df96-4465-91c4-461d56b2d9bf service nova] Enqueued Resource ID: 4006cdf4-0520-444e-a405-b5c06042971f with Priority: HIGHEST for action port [ 669.977432] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea7752c-71a7-48c6-ad69-e6c96549e90c with Priority: HIGHEST for action security_group_rules [ 669.977432] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea7752c-71a7-48c6-ad69-e6c96549e90c with Priority: HIGHEST for action security_group_members [ 669.977432] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4006cdf4-0520-444e-a405-b5c06042971f with Priority: HIGHEST for action port [ 669.978907] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dea7752c-71a7-48c6-ad69-e6c96549e90c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.978907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.978907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.978907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.978907] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dea7752c-71a7-48c6-ad69-e6c96549e90c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.981216] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea7752c-71a7-48c6-ad69-e6c96549e90c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.981216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.981216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.981216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.981216] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.981216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.981216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.981216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.981216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.981216] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea7752c-71a7-48c6-ad69-e6c96549e90c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.982026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-4006cdf4-0520-444e-a405-b5c06042971f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.982026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4006cdf4-0520-444e-a405-b5c06042971f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.982026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4006cdf4-0520-444e-a405-b5c06042971f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.982026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4006cdf4-0520-444e-a405-b5c06042971f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.982354] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4006cdf4-0520-444e-a405-b5c06042971f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.160452] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0312fae9-4e47-4e46-a2ba-9f72de121989 [ 670.162025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.162025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.162025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.162025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.162025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.162025] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0312fae9-4e47-4e46-a2ba-9f72de121989 already deleted. [ 670.162025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0312fae9-4e47-4e46-a2ba-9f72de121989" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.278704] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: SUCCESS [ 670.278927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.279122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.279367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.279673] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.279829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.279872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.280243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.280243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.280243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.280359] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.337643] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.337828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.337948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.339102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.339102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.339102] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.339102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.339102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.339102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.339102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.339102] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 is going to be updated. [ 670.368114] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.368114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.368114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.368114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.368114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.379920] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 in Status: IN_PROGRESS for 2s [ 670.458631] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce4411d7-76e6-4130-943d-ad36e3ccc504 req-c6d367b9-b052-4cdd-ae3c-27eaaac01183 tempest-ImagesNegativeTestJSON-581848103 tempest-ImagesNegativeTestJSON-581848103-project-member] Enqueued Resource ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f with Priority: HIGHEST for action security_group_members [ 670.458631] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f with Priority: HIGHEST for action security_group_members [ 670.458631] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c879b90-76f3-430e-8b1f-ba2fe27e511f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.458631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.458631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.460693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.460752] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.460876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.461016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.461121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.461201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.461298] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c879b90-76f3-430e-8b1f-ba2fe27e511f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.484900] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea7752c-71a7-48c6-ad69-e6c96549e90c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.484900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.484900] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dea7752c-71a7-48c6-ad69-e6c96549e90c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.486462] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4006cdf4-0520-444e-a405-b5c06042971f with status ACTIVE [ 670.487205] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.487205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.487205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.487205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.487580] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.487580] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.487693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.487743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.488758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.488758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.488758] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.488758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.488758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.488758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.488758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.488758] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4006cdf4-0520-444e-a405-b5c06042971f is going to be updated. [ 670.501307] env[69647]: INFO networking_nsxv3.common.synchronization [None req-615e7435-4170-46f5-a60e-8d7254e4cc07 tempest-ServerActionsTestOtherB-626642147 tempest-ServerActionsTestOtherB-626642147-project-member] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 670.502028] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 670.502956] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.502956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.502956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.503160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.503232] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.511053] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b in Status: SUCCESS [ 670.511584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.515102] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.515244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.515304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.515509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.515646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.515798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4006cdf4-0520-444e-a405-b5c06042971f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.764257] env[69647]: INFO networking_nsxv3.common.synchronization [None req-184c9eb9-eab9-4616-b454-bc5f30d90243 tempest-ServerActionsTestOtherB-626642147 tempest-ServerActionsTestOtherB-626642147-project-member] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 670.764701] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 670.765158] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.765158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.783663] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.965597] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.965597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.965597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.965597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.965597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.965597] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.965597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.965597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.965597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.965597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.965597] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f already deleted. [ 670.965597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.987302] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dea7752c-71a7-48c6-ad69-e6c96549e90c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.027320] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.027320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.027320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.027320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.027320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.027320] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 already deleted. [ 671.027320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.027320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.027320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.027320] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.108980] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-447 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.109397] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-447" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.109621] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-447" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.110041] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-447" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.110401] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.110725] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.110938] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.111264] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.111504] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.111797] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.112125] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.112348] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.112548] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.112741] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.112936] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.113191] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.134152] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.134152] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 671.134152] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.134152] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-447" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.134152] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1a1082df-3573-46ac-b998-51f2cd65f17a taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.134152] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1a1082df-3573-46ac-b998-51f2cd65f17a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.134152] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1a1082df-3573-46ac-b998-51f2cd65f17a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.134152] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1a1082df-3573-46ac-b998-51f2cd65f17a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.134152] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a1082df-3573-46ac-b998-51f2cd65f17a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.289958] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b26cf444-4671-4a90-a2a4-c6ca9787ad9f: rpc.has_security_group_logging(os_id): False [ 671.315610] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.315610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.315610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.315610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.315610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.315610] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.315610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.315610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.315610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.315610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.315610] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f is going to be created. [ 671.393493] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.393493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.393493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.393493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.393493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.404033] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: IN_PROGRESS for 2s [ 671.488754] env[69647]: INFO networking_nsxv3.common.synchronization [None req-effb57a9-873d-4c8b-8529-d9fc4647c0c2 None None] Enqueued Resource ID: b74ba9ed-e072-42fd-90e9-c9da1645019a with Priority: HIGHEST for action port [ 671.489199] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b74ba9ed-e072-42fd-90e9-c9da1645019a with Priority: HIGHEST for action port [ 671.492371] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.492641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.492641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.493824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.493824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.493824] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea7752c-71a7-48c6-ad69-e6c96549e90c is going to be created. [ 671.494498] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b74ba9ed-e072-42fd-90e9-c9da1645019a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.494642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b74ba9ed-e072-42fd-90e9-c9da1645019a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.494783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b74ba9ed-e072-42fd-90e9-c9da1645019a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.494997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b74ba9ed-e072-42fd-90e9-c9da1645019a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.495808] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b74ba9ed-e072-42fd-90e9-c9da1645019a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.522254] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.522442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.522485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.523500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.523500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.536956] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea7752c-71a7-48c6-ad69-e6c96549e90c in Status: UNINITIALIZED for 2s [ 671.557180] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.557323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.557389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.557607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.557692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.557787] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 already deleted. [ 671.557866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.639354] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.639917] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.641706] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.641706] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.647210] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.647210] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1a1082df-3573-46ac-b998-51f2cd65f17a not found, creating... [ 671.647210] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.647210] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.647210] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.648066] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.648066] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.648066] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.648066] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.648242] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.648377] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.648649] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.648720] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1a1082df-3573-46ac-b998-51f2cd65f17a is going to be created. [ 671.672494] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.673808] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.673808] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.673808] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.673808] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.673808] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1a1082df-3573-46ac-b998-51f2cd65f17a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.000183] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b74ba9ed-e072-42fd-90e9-c9da1645019a [ 672.000408] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.000583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.000660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.000888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.000973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.001080] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b74ba9ed-e072-42fd-90e9-c9da1645019a already deleted. [ 672.001173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b74ba9ed-e072-42fd-90e9-c9da1645019a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.193380] env[69647]: INFO networking_nsxv3.common.synchronization [req-a274b7d7-6ab2-436c-ba8f-c63bb5888e1e req-6d5850cf-b829-452a-a237-3e4732c06503 tempest-SecurityGroupRulesTestJSON-1339677363 tempest-SecurityGroupRulesTestJSON-1339677363-project-member] Enqueued Resource ID: 6b44353c-32e3-47e5-886e-7ae8a0d9be01 with Priority: HIGHEST for action security_group_rules [ 672.193380] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b44353c-32e3-47e5-886e-7ae8a0d9be01 with Priority: HIGHEST for action security_group_rules [ 672.193380] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b44353c-32e3-47e5-886e-7ae8a0d9be01 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.193380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b44353c-32e3-47e5-886e-7ae8a0d9be01" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.193657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b44353c-32e3-47e5-886e-7ae8a0d9be01" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.193657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b44353c-32e3-47e5-886e-7ae8a0d9be01" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.193745] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b44353c-32e3-47e5-886e-7ae8a0d9be01',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.389709] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 in Status: SUCCESS [ 672.389879] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26d75834-c6a8-4d76-af3a-6cec3f2d79e2 deletion is rescheduled due to dependency. [ 672.389994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26d75834-c6a8-4d76-af3a-6cec3f2d79e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.501931] env[69647]: INFO networking_nsxv3.common.synchronization [None req-3257f788-4b2a-4040-94eb-8db995dfe81f None None] Enqueued Resource ID: 52e85df8-e3ae-4c03-bc82-66629f5143c2 with Priority: HIGHEST for action port [ 672.501931] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52e85df8-e3ae-4c03-bc82-66629f5143c2 with Priority: HIGHEST for action port [ 672.504127] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-52e85df8-e3ae-4c03-bc82-66629f5143c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.504127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52e85df8-e3ae-4c03-bc82-66629f5143c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.504127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52e85df8-e3ae-4c03-bc82-66629f5143c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.504127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52e85df8-e3ae-4c03-bc82-66629f5143c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.504127] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52e85df8-e3ae-4c03-bc82-66629f5143c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.715019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.716035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.716176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.716523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.716523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.716637] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b44353c-32e3-47e5-886e-7ae8a0d9be01 already deleted. [ 672.716750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b44353c-32e3-47e5-886e-7ae8a0d9be01" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.872831] env[69647]: INFO networking_nsxv3.common.synchronization [None req-ca07c725-d088-4a21-98d8-8013e31b308f None None] Enqueued Resource ID: 1aaae261-dc72-49e8-88eb-a9a87efab344 with Priority: HIGHEST for action port [ 672.875166] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aaae261-dc72-49e8-88eb-a9a87efab344 with Priority: HIGHEST for action port [ 672.875166] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aaae261-dc72-49e8-88eb-a9a87efab344 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.875166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aaae261-dc72-49e8-88eb-a9a87efab344" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.875166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aaae261-dc72-49e8-88eb-a9a87efab344" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.875166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aaae261-dc72-49e8-88eb-a9a87efab344" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.875166] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aaae261-dc72-49e8-88eb-a9a87efab344',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.928135] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce4411d7-76e6-4130-943d-ad36e3ccc504 req-b5bb9c99-a2bc-466f-aac2-406e1d24cb1a service nova] Enqueued Resource ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f with Priority: HIGHEST for action security_group_rules [ 672.928240] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce4411d7-76e6-4130-943d-ad36e3ccc504 req-b5bb9c99-a2bc-466f-aac2-406e1d24cb1a service nova] Enqueued Resource ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f with Priority: HIGHEST for action security_group_members [ 672.928286] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce4411d7-76e6-4130-943d-ad36e3ccc504 req-b5bb9c99-a2bc-466f-aac2-406e1d24cb1a service nova] Enqueued Resource ID: 1a1082df-3573-46ac-b998-51f2cd65f17a with Priority: HIGHEST for action port [ 672.929617] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f with Priority: HIGHEST for action security_group_rules [ 672.929617] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f with Priority: HIGHEST for action security_group_members [ 672.929617] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1082df-3573-46ac-b998-51f2cd65f17a with Priority: HIGHEST for action port [ 672.929951] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c879b90-76f3-430e-8b1f-ba2fe27e511f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.930051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.930111] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.930353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.930431] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c879b90-76f3-430e-8b1f-ba2fe27e511f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.931334] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c879b90-76f3-430e-8b1f-ba2fe27e511f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.931676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.931676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.931774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.931868] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.931981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.932073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.932278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.932315] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.932398] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c879b90-76f3-430e-8b1f-ba2fe27e511f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.933212] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a1082df-3573-46ac-b998-51f2cd65f17a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.933329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a1082df-3573-46ac-b998-51f2cd65f17a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.933329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a1082df-3573-46ac-b998-51f2cd65f17a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.933477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a1082df-3573-46ac-b998-51f2cd65f17a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.933704] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a1082df-3573-46ac-b998-51f2cd65f17a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.006010] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52e85df8-e3ae-4c03-bc82-66629f5143c2 [ 673.006289] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.006462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.006575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.006829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.006942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.008158] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52e85df8-e3ae-4c03-bc82-66629f5143c2 already deleted. [ 673.008317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52e85df8-e3ae-4c03-bc82-66629f5143c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.377091] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1aaae261-dc72-49e8-88eb-a9a87efab344 [ 673.377321] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.377453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.377518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.377731] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.378549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.378549] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1aaae261-dc72-49e8-88eb-a9a87efab344 already deleted. [ 673.378807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aaae261-dc72-49e8-88eb-a9a87efab344" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.417665] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: SUCCESS [ 673.417820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.440438] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a1082df-3573-46ac-b998-51f2cd65f17a with status ACTIVE [ 673.440795] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.440996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.441882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.441882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.441882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.441882] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.441882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.442119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.442152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.442846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.442846] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.442846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.442846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.443072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.443173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.443685] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a1082df-3573-46ac-b998-51f2cd65f17a is going to be updated. [ 673.445802] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c879b90-76f3-430e-8b1f-ba2fe27e511f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.446804] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c879b90-76f3-430e-8b1f-ba2fe27e511f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.446925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.473914] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.474654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.474654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.474782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.474999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.476038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a1082df-3573-46ac-b998-51f2cd65f17a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.548866] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea7752c-71a7-48c6-ad69-e6c96549e90c in Status: SUCCESS [ 673.549642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.549642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.549861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.550081] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.550206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.550271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.550431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.550512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.550617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.550723] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dea7752c-71a7-48c6-ad69-e6c96549e90c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.948529] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c879b90-76f3-430e-8b1f-ba2fe27e511f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.053576] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea7752c-71a7-48c6-ad69-e6c96549e90c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.053745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.053819] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.054050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.054281] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.054355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.054394] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.055421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.055421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.055421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.055421] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea7752c-71a7-48c6-ad69-e6c96549e90c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.055421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.055421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.055421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.055421] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.055421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.055421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.055830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.055830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.055830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.055830] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dea7752c-71a7-48c6-ad69-e6c96549e90c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.233808] env[69647]: INFO networking_nsxv3.common.synchronization [req-e07c5f4a-733c-40e0-8296-a277ca7d3ee6 req-8939b4d1-643d-47ed-85b1-05ffc91b4e14 tempest-ServerMetadataTestJSON-1717528321 tempest-ServerMetadataTestJSON-1717528321-project-member] Enqueued Resource ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 with Priority: HIGHEST for action security_group_members [ 674.234475] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 with Priority: HIGHEST for action security_group_members [ 674.234475] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.234639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.234639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.234911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.235694] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.236076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.236249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.237026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.237026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.237026] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7089450c-93b7-4d5b-bc9f-a1a19b5783e0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.451368] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.454358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.454358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.454358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.454358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.454358] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f is going to be created. [ 674.476010] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.478368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.478368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.478368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.478368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.486364] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f in Status: UNINITIALIZED for 2s [ 674.558344] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dea7752c-71a7-48c6-ad69-e6c96549e90c: rpc.has_security_group_logging(os_id): False [ 674.579021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.579021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.579021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.579021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.579633] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.579633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.579859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.580097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.580196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.580280] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dea7752c-71a7-48c6-ad69-e6c96549e90c is going to be created. [ 674.636734] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.636734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.636734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.636734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.636734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.646271] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dea7752c-71a7-48c6-ad69-e6c96549e90c in Status: IN_PROGRESS for 2s [ 674.740678] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.740678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.740678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.740678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.740678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.740678] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.740678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.740678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.740678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.740678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.740678] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 already deleted. [ 674.740678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.803232] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.803232] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-513" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.803232] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-513" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.803232] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-513" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.803232] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.803232] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.805365] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.806023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.806023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.806146] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.806902] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.807148] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.807214] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.807391] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.807479] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.807639] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.825789] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.829023] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 674.829023] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.829023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-513" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.829023] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-a4651a16-ef35-407b-96aa-684eb53583ac taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.829023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-a4651a16-ef35-407b-96aa-684eb53583ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.829023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-a4651a16-ef35-407b-96aa-684eb53583ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.829023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-a4651a16-ef35-407b-96aa-684eb53583ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.829023] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4651a16-ef35-407b-96aa-684eb53583ac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.043096] env[69647]: INFO networking_nsxv3.common.synchronization [None req-117bd242-1bdd-4fd0-832c-2814f782a445 None None] Enqueued Resource ID: cee360af-98d3-43b4-86bd-0c97304cffeb with Priority: HIGHEST for action port [ 675.043834] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cee360af-98d3-43b4-86bd-0c97304cffeb with Priority: HIGHEST for action port [ 675.045412] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-cee360af-98d3-43b4-86bd-0c97304cffeb taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.045412] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cee360af-98d3-43b4-86bd-0c97304cffeb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.045412] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cee360af-98d3-43b4-86bd-0c97304cffeb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.045992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cee360af-98d3-43b4-86bd-0c97304cffeb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.046270] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cee360af-98d3-43b4-86bd-0c97304cffeb',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.331456] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.331708] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.331845] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.332687] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.332687] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.332687] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port a4651a16-ef35-407b-96aa-684eb53583ac not found, creating... [ 675.332970] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.332970] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.333123] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.333820] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.333820] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.333820] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.333820] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.334707] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.335136] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.335136] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.335243] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: a4651a16-ef35-407b-96aa-684eb53583ac is going to be created. [ 675.355194] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.355518] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.355646] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.355920] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.356169] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.356386] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-a4651a16-ef35-407b-96aa-684eb53583ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.381823] env[69647]: INFO networking_nsxv3.common.synchronization [None req-4b1a904a-33f5-4c71-bda4-92bc91d46812 None None] Enqueued Resource ID: 8e9edbf1-2eba-40ce-9822-40d581f2011b with Priority: HIGHEST for action port [ 675.382112] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e9edbf1-2eba-40ce-9822-40d581f2011b with Priority: HIGHEST for action port [ 675.382682] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e9edbf1-2eba-40ce-9822-40d581f2011b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.382827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e9edbf1-2eba-40ce-9822-40d581f2011b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.382865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e9edbf1-2eba-40ce-9822-40d581f2011b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.383928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e9edbf1-2eba-40ce-9822-40d581f2011b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.383928] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e9edbf1-2eba-40ce-9822-40d581f2011b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.549486] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cee360af-98d3-43b4-86bd-0c97304cffeb [ 675.550869] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.550869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.550869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.551463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.552299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.552299] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cee360af-98d3-43b4-86bd-0c97304cffeb already deleted. [ 675.552411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cee360af-98d3-43b4-86bd-0c97304cffeb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.887550] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e9edbf1-2eba-40ce-9822-40d581f2011b [ 675.887959] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.887959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.888991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.888991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.888991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.888991] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e9edbf1-2eba-40ce-9822-40d581f2011b already deleted. [ 675.889229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e9edbf1-2eba-40ce-9822-40d581f2011b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.031379] env[69647]: INFO networking_nsxv3.common.synchronization [req-2b403b38-9cd0-4196-83fc-cbe5b5fdfaa6 req-3d3cb279-6726-4450-be95-e35c175328a5 tempest-ServerDiagnosticsNegativeTest-99990549 tempest-ServerDiagnosticsNegativeTest-99990549-project-member] Enqueued Resource ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f with Priority: HIGHEST for action security_group_members [ 676.032050] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f with Priority: HIGHEST for action security_group_members [ 676.032218] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.032218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.032308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.032479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.032627] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.032735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.032778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.032998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.033164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.033275] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2e36bcf-78c7-4f7b-8f47-dd80eafb244f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.144765] env[69647]: INFO networking_nsxv3.common.synchronization [req-e07c5f4a-733c-40e0-8296-a277ca7d3ee6 req-56577e1f-70e8-42f0-bf47-23155946436f service nova] Enqueued Resource ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 with Priority: HIGHEST for action security_group_rules [ 676.145505] env[69647]: INFO networking_nsxv3.common.synchronization [req-e07c5f4a-733c-40e0-8296-a277ca7d3ee6 req-56577e1f-70e8-42f0-bf47-23155946436f service nova] Enqueued Resource ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 with Priority: HIGHEST for action security_group_members [ 676.145747] env[69647]: INFO networking_nsxv3.common.synchronization [req-e07c5f4a-733c-40e0-8296-a277ca7d3ee6 req-56577e1f-70e8-42f0-bf47-23155946436f service nova] Enqueued Resource ID: a4651a16-ef35-407b-96aa-684eb53583ac with Priority: HIGHEST for action port [ 676.146391] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 with Priority: HIGHEST for action security_group_rules [ 676.147808] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 with Priority: HIGHEST for action security_group_members [ 676.147808] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4651a16-ef35-407b-96aa-684eb53583ac with Priority: HIGHEST for action port [ 676.147808] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7089450c-93b7-4d5b-bc9f-a1a19b5783e0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.147808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.147808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.147808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.147808] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7089450c-93b7-4d5b-bc9f-a1a19b5783e0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.154357] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.154357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.154357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.154357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.154357] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.154357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.154357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.154357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.154357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.154357] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7089450c-93b7-4d5b-bc9f-a1a19b5783e0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.154357] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4651a16-ef35-407b-96aa-684eb53583ac taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.156057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4651a16-ef35-407b-96aa-684eb53583ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.156057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4651a16-ef35-407b-96aa-684eb53583ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.156057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4651a16-ef35-407b-96aa-684eb53583ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.156057] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4651a16-ef35-407b-96aa-684eb53583ac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.500141] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f in Status: SUCCESS [ 676.500417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.500530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.500783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.500971] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.501100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.501161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.501755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.501755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.501755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.501755] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c879b90-76f3-430e-8b1f-ba2fe27e511f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.539286] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.539286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.539286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.539286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.539286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.539286] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.539286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.539286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.539286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.539286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.539286] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f is going to be updated. [ 676.561178] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.561485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.561717] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.562015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.562247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.570980] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f in Status: IN_PROGRESS for 2s [ 676.626890] env[69647]: INFO networking_nsxv3.common.synchronization [req-4b425cbe-590f-4406-825b-fd76f3eb9c20 req-1a263566-ed73-4f6f-99c1-a2ba6bb4297c tempest-FloatingIPsAssociationTestJSON-597742564 tempest-FloatingIPsAssociationTestJSON-597742564-project-member] Enqueued Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 676.627702] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 676.627751] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.627832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.628165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.628486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.628551] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.628626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.628763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.629628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.629628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.629628] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.652283] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.652283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.660434] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dea7752c-71a7-48c6-ad69-e6c96549e90c in Status: SUCCESS [ 676.660716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.661206] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7089450c-93b7-4d5b-bc9f-a1a19b5783e0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.665065] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4651a16-ef35-407b-96aa-684eb53583ac with status ACTIVE [ 676.665065] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.665065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.665065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.665065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.665065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.665065] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.665065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.665065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.665065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.665065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.665065] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.665065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.665551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.665551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.665551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.665551] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4651a16-ef35-407b-96aa-684eb53583ac is going to be updated. [ 676.691809] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.691876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.692055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.692181] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.692447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.692447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4651a16-ef35-407b-96aa-684eb53583ac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.004475] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c879b90-76f3-430e-8b1f-ba2fe27e511f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.004959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.004959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.005040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.005671] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.005671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.005671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.006679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.006679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.006679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.006679] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c879b90-76f3-430e-8b1f-ba2fe27e511f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.006870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.006870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.006944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.007923] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.008560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.008649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.009339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.009339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.009339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.009339] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c879b90-76f3-430e-8b1f-ba2fe27e511f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.133036] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.167339] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7089450c-93b7-4d5b-bc9f-a1a19b5783e0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.451038] env[69647]: INFO networking_nsxv3.common.synchronization [None req-04221d91-0a1e-416a-9046-cabbbf6675b9 None None] Enqueued Resource ID: 25468a1d-a19d-4f1f-91a1-5a973b8c4db8 with Priority: HIGHEST for action port [ 677.452043] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25468a1d-a19d-4f1f-91a1-5a973b8c4db8 with Priority: HIGHEST for action port [ 677.452043] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-25468a1d-a19d-4f1f-91a1-5a973b8c4db8 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.452043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25468a1d-a19d-4f1f-91a1-5a973b8c4db8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.452705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25468a1d-a19d-4f1f-91a1-5a973b8c4db8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.453201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25468a1d-a19d-4f1f-91a1-5a973b8c4db8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.453264] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25468a1d-a19d-4f1f-91a1-5a973b8c4db8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.514021] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c879b90-76f3-430e-8b1f-ba2fe27e511f: rpc.has_security_group_logging(os_id): False [ 677.533550] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.533739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.533784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.533982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.534080] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.536839] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.536839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.536839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.536839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.536839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.536839] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.536839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.536839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.536839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.536839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.536839] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.536839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.536839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.536839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.537453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.537453] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f is going to be created. [ 677.590036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.590214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.590289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.590521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.590767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.610478] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f in Status: IN_PROGRESS for 2s [ 677.638537] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.670797] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.670960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.671049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.671269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.671395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.671531] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 is going to be created. [ 677.702218] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.702367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.702414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.702904] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.702904] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.718359] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-730 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.718562] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-730" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.718686] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-730" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.718969] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-730" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.719244] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.719399] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.719514] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.719745] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.719953] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.724322] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.724465] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.724659] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.724722] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.724919] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.724983] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.725103] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.727451] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 in Status: UNINITIALIZED for 2s [ 677.757276] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.757447] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 677.757604] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.758542] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-730" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.758910] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-d75199f6-f428-4cf2-bae0-9d05da206a6c taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.759110] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-d75199f6-f428-4cf2-bae0-9d05da206a6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.759234] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-d75199f6-f428-4cf2-bae0-9d05da206a6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.759617] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-d75199f6-f428-4cf2-bae0-9d05da206a6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.759796] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d75199f6-f428-4cf2-bae0-9d05da206a6c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.955990] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25468a1d-a19d-4f1f-91a1-5a973b8c4db8 [ 677.956422] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.957195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.957195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.957477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.957772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.958147] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25468a1d-a19d-4f1f-91a1-5a973b8c4db8 already deleted. [ 677.958303] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25468a1d-a19d-4f1f-91a1-5a973b8c4db8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.014689] env[69647]: INFO networking_nsxv3.common.synchronization [req-16c947a6-eb92-4bb0-be64-ca6caf39a1c4 req-70e78ebb-f194-4039-9841-a18de4244d39 tempest-SecurityGroupRulesNegativeTestJSON-1229604690 tempest-SecurityGroupRulesNegativeTestJSON-1229604690-project-member] Enqueued Resource ID: be6dc252-219e-4cce-94c2-0e16e8eb250a with Priority: HIGHEST for action security_group_rules [ 678.015995] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be6dc252-219e-4cce-94c2-0e16e8eb250a with Priority: HIGHEST for action security_group_rules [ 678.016398] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be6dc252-219e-4cce-94c2-0e16e8eb250a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.016531] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be6dc252-219e-4cce-94c2-0e16e8eb250a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.016887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be6dc252-219e-4cce-94c2-0e16e8eb250a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.017017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be6dc252-219e-4cce-94c2-0e16e8eb250a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.017198] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be6dc252-219e-4cce-94c2-0e16e8eb250a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.141514] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.141514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.141713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.141782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.142040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.142040] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b is going to be updated. [ 678.167235] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.167235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.167235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.167763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.167876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.177299] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: IN_PROGRESS for 2s [ 678.264308] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.264308] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.264434] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.265583] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.265583] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.265583] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port d75199f6-f428-4cf2-bae0-9d05da206a6c not found, creating... [ 678.265583] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.265583] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.265583] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.266061] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.266259] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.267194] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.267194] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.267194] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.268101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.268101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.268101] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: d75199f6-f428-4cf2-bae0-9d05da206a6c is going to be created. [ 678.289270] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.289509] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.289658] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.290188] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.290188] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.290409] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-d75199f6-f428-4cf2-bae0-9d05da206a6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.542910] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.542910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.542910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.542910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.542910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.542910] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be6dc252-219e-4cce-94c2-0e16e8eb250a already deleted. [ 678.542910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be6dc252-219e-4cce-94c2-0e16e8eb250a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.582545] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f in Status: SUCCESS [ 678.582545] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f deletion is rescheduled due to dependency. [ 678.582545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.089353] env[69647]: INFO networking_nsxv3.common.synchronization [None req-970bece5-dc88-4613-bf6c-be473e1415cc None None] Enqueued Resource ID: 95aab392-6451-45f1-919a-218d47c02af2 with Priority: HIGHEST for action port [ 679.089626] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95aab392-6451-45f1-919a-218d47c02af2 with Priority: HIGHEST for action port [ 679.090226] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-95aab392-6451-45f1-919a-218d47c02af2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.090352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95aab392-6451-45f1-919a-218d47c02af2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.090423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95aab392-6451-45f1-919a-218d47c02af2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.090803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95aab392-6451-45f1-919a-218d47c02af2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.090928] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95aab392-6451-45f1-919a-218d47c02af2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.157934] env[69647]: INFO networking_nsxv3.common.synchronization [req-bb33619f-403f-47ea-aa17-37471881154a req-ce0e32a7-bfda-458d-8cc3-732369f27672 tempest-ServerDiagnosticsTest-1196137100 tempest-ServerDiagnosticsTest-1196137100-project-member] Enqueued Resource ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b with Priority: HIGHEST for action security_group_members [ 679.158189] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b with Priority: HIGHEST for action security_group_members [ 679.158421] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-67fa0349-fc9a-4525-98b6-98f14f9e267b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.158581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.158693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.158815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.158968] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.159941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.159941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.160142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.160237] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.160369] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67fa0349-fc9a-4525-98b6-98f14f9e267b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.308630] env[69647]: INFO networking_nsxv3.common.synchronization [req-a34c307e-78ca-4f18-a9c0-e49cd3e74f44 req-a8508ddd-bf18-4feb-bae7-ddc1372f4442 tempest-SecurityGroupRulesTestJSON-1339677363 tempest-SecurityGroupRulesTestJSON-1339677363-project-member] Enqueued Resource ID: 6b0174ed-5027-41e3-bf0c-6641441c40ec with Priority: HIGHEST for action security_group_rules [ 679.313020] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b0174ed-5027-41e3-bf0c-6641441c40ec with Priority: HIGHEST for action security_group_rules [ 679.313020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b0174ed-5027-41e3-bf0c-6641441c40ec taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.313020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.313020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.313020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.313020] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b0174ed-5027-41e3-bf0c-6641441c40ec',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.329167] env[69647]: INFO networking_nsxv3.common.synchronization [req-4b425cbe-590f-4406-825b-fd76f3eb9c20 req-15365198-9523-412a-b870-3a23e5e03e9d service nova] Enqueued Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_rules [ 679.329390] env[69647]: INFO networking_nsxv3.common.synchronization [req-4b425cbe-590f-4406-825b-fd76f3eb9c20 req-15365198-9523-412a-b870-3a23e5e03e9d service nova] Enqueued Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 679.329645] env[69647]: INFO networking_nsxv3.common.synchronization [req-4b425cbe-590f-4406-825b-fd76f3eb9c20 req-15365198-9523-412a-b870-3a23e5e03e9d service nova] Enqueued Resource ID: d75199f6-f428-4cf2-bae0-9d05da206a6c with Priority: HIGHEST for action port [ 679.330085] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_rules [ 679.330220] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 679.330317] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d75199f6-f428-4cf2-bae0-9d05da206a6c with Priority: HIGHEST for action port [ 679.330582] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.330761] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.330827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.331113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.331225] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.332107] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.332206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.332393] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-d75199f6-f428-4cf2-bae0-9d05da206a6c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.332511] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d75199f6-f428-4cf2-bae0-9d05da206a6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.332554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d75199f6-f428-4cf2-bae0-9d05da206a6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.332770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d75199f6-f428-4cf2-bae0-9d05da206a6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.332870] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d75199f6-f428-4cf2-bae0-9d05da206a6c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.595077] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95aab392-6451-45f1-919a-218d47c02af2 [ 679.596865] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.596865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.596865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.596865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.596865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.596865] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95aab392-6451-45f1-919a-218d47c02af2 already deleted. [ 679.596865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95aab392-6451-45f1-919a-218d47c02af2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.627038] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f in Status: SUCCESS [ 679.627687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.664886] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.665104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.665204] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.665440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.665550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.665771] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.665892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.665970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.666155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.666255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.666359] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b is going to be updated. [ 679.693196] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.693341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.693400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.693617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.693758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.701817] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b in Status: IN_PROGRESS for 2s [ 679.736274] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 in Status: SUCCESS [ 679.739687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.739687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.739687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.739687] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.739687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.739687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.739687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.739687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.739687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.739687] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7089450c-93b7-4d5b-bc9f-a1a19b5783e0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.834229] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.834380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.834452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.834667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.834757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.834855] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b0174ed-5027-41e3-bf0c-6641441c40ec already deleted. [ 679.834937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.835242] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.835333] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.835483] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d75199f6-f428-4cf2-bae0-9d05da206a6c with status ACTIVE [ 679.835629] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.835722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.835781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.835943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.836048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.836348] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.836348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.836348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.836509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.836633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.836732] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.836815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.836873] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.836998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.837076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.837161] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d75199f6-f428-4cf2-bae0-9d05da206a6c is going to be updated. [ 679.857407] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.857564] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.857630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.857825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.858065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.858131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d75199f6-f428-4cf2-bae0-9d05da206a6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.047605] env[69647]: INFO networking_nsxv3.common.synchronization [None req-786d087b-c2b1-4f2f-91a4-efb9b1a66267 None None] Enqueued Resource ID: 42cc3d96-8373-4f36-a605-4c283324dba0 with Priority: HIGHEST for action port [ 680.047605] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42cc3d96-8373-4f36-a605-4c283324dba0 with Priority: HIGHEST for action port [ 680.047605] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-42cc3d96-8373-4f36-a605-4c283324dba0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.047605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42cc3d96-8373-4f36-a605-4c283324dba0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.047605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42cc3d96-8373-4f36-a605-4c283324dba0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.047605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42cc3d96-8373-4f36-a605-4c283324dba0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.047605] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42cc3d96-8373-4f36-a605-4c283324dba0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.192280] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: SUCCESS [ 680.192585] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.193936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.193936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.193936] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.193936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.193936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.193936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.193936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.193936] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.245598] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.245598] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.245598] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.245598] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.245598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.246225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.246225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.246523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.247334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.247334] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7089450c-93b7-4d5b-bc9f-a1a19b5783e0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.551208] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42cc3d96-8373-4f36-a605-4c283324dba0 [ 680.551208] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.551208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.551208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.551208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.551208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.551208] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42cc3d96-8373-4f36-a605-4c283324dba0 already deleted. [ 680.551208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42cc3d96-8373-4f36-a605-4c283324dba0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.696318] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.751753] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7089450c-93b7-4d5b-bc9f-a1a19b5783e0: rpc.has_security_group_logging(os_id): False [ 680.771034] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.771034] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.771034] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.771034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.772104] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.772104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.772104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.772104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.772104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.772104] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 is going to be created. [ 680.802085] env[69647]: INFO networking_nsxv3.common.synchronization [req-cf94d9a1-284d-458b-a2d1-d7271134fb06 req-25a0186e-4ef7-43e9-a33d-bef39a86d172 tempest-SecurityGroupRulesTestJSON-1339677363 tempest-SecurityGroupRulesTestJSON-1339677363-project-member] Enqueued Resource ID: 6b0174ed-5027-41e3-bf0c-6641441c40ec with Priority: HIGHEST for action security_group_rules [ 680.802677] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b0174ed-5027-41e3-bf0c-6641441c40ec with Priority: HIGHEST for action security_group_rules [ 680.802755] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b0174ed-5027-41e3-bf0c-6641441c40ec taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.802861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.802902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.803111] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.803203] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b0174ed-5027-41e3-bf0c-6641441c40ec',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.851362] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.851509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.851581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.851791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.851972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.862495] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 in Status: IN_PROGRESS for 2s [ 681.083136] env[69647]: INFO networking_nsxv3.common.synchronization [req-fb1a7b10-b9b7-4865-9cee-ad4e278a9ee9 req-814fe3ff-ae44-4411-9d5f-5f47196b63a9 tempest-SecurityGroupRulesNegativeTestJSON-1229604690 tempest-SecurityGroupRulesNegativeTestJSON-1229604690-project-member] Enqueued Resource ID: be6dc252-219e-4cce-94c2-0e16e8eb250a with Priority: HIGHEST for action security_group_rules [ 681.083672] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be6dc252-219e-4cce-94c2-0e16e8eb250a with Priority: HIGHEST for action security_group_rules [ 681.083762] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be6dc252-219e-4cce-94c2-0e16e8eb250a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.083851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be6dc252-219e-4cce-94c2-0e16e8eb250a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.083917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be6dc252-219e-4cce-94c2-0e16e8eb250a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.086382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be6dc252-219e-4cce-94c2-0e16e8eb250a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.086382] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be6dc252-219e-4cce-94c2-0e16e8eb250a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.198674] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.323614] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.323761] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.323761] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.323993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.324041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.324129] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b0174ed-5027-41e3-bf0c-6641441c40ec already deleted. [ 681.324202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.609024] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.609024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.609024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.609024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.609024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.609024] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be6dc252-219e-4cce-94c2-0e16e8eb250a already deleted. [ 681.609024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be6dc252-219e-4cce-94c2-0e16e8eb250a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.626546] env[69647]: INFO networking_nsxv3.common.synchronization [None req-d9ad5db3-2e25-4961-bdcc-8331c9f9285e None None] Enqueued Resource ID: 3777ad1a-34aa-45a8-9642-183d884ca0ab with Priority: HIGHEST for action port [ 681.627072] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3777ad1a-34aa-45a8-9642-183d884ca0ab with Priority: HIGHEST for action port [ 681.627369] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3777ad1a-34aa-45a8-9642-183d884ca0ab taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.628153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3777ad1a-34aa-45a8-9642-183d884ca0ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.628153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3777ad1a-34aa-45a8-9642-183d884ca0ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.628153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3777ad1a-34aa-45a8-9642-183d884ca0ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.628153] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3777ad1a-34aa-45a8-9642-183d884ca0ab',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.705501] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.705501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.705501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.705501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.705501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.705501] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b is going to be updated. [ 681.712468] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b in Status: SUCCESS [ 681.712649] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67fa0349-fc9a-4525-98b6-98f14f9e267b deletion is rescheduled due to dependency. [ 681.712772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67fa0349-fc9a-4525-98b6-98f14f9e267b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.728322] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.728469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.728545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.728876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.729039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.737493] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: IN_PROGRESS for 2s [ 681.935527] env[69647]: INFO networking_nsxv3.common.synchronization [None req-b96d6d98-1cec-4f4b-9ef1-2cca385ecdec tempest-ServersTestManualDisk-61462443 tempest-ServersTestManualDisk-61462443-project-member] Enqueued Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_rules [ 681.935527] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_rules [ 681.935693] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.935761] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.935800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.937959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.938137] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627fe875-c21d-4d02-9ec5-0f012cb64fc1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.054685] env[69647]: INFO networking_nsxv3.common.synchronization [None req-3503f0fc-282a-4e89-ab9b-d927d1c31843 tempest-ServersTestManualDisk-61462443 tempest-ServersTestManualDisk-61462443-project-member] Enqueued Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_rules [ 682.055916] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_rules [ 682.056404] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.056593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.138480] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3777ad1a-34aa-45a8-9642-183d884ca0ab [ 682.138480] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.138480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.138480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.138480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.138480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.138480] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3777ad1a-34aa-45a8-9642-183d884ca0ab already deleted. [ 682.138480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3777ad1a-34aa-45a8-9642-183d884ca0ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.460227] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.460536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.460536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.460686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.461336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.461336] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 already deleted. [ 682.461336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.461336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.461501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.461565] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627fe875-c21d-4d02-9ec5-0f012cb64fc1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.875633] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 in Status: SUCCESS [ 682.875633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.982177] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.982334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.983661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.983995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.984114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.984238] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 already deleted. [ 682.984324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.191163] env[69647]: INFO networking_nsxv3.common.synchronization [req-6a92eb1b-43c8-43bb-9eb3-feed3c486ba2 req-1ca0b4f1-b45e-4406-b20e-8bd3ef733aba tempest-SecurityGroupRulesTestJSON-1339677363 tempest-SecurityGroupRulesTestJSON-1339677363-project-member] Enqueued Resource ID: 6b0174ed-5027-41e3-bf0c-6641441c40ec with Priority: HIGHEST for action security_group_rules [ 683.191774] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b0174ed-5027-41e3-bf0c-6641441c40ec with Priority: HIGHEST for action security_group_rules [ 683.192124] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b0174ed-5027-41e3-bf0c-6641441c40ec taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.192223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.192272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.192490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.192565] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b0174ed-5027-41e3-bf0c-6641441c40ec',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.417547] env[69647]: INFO networking_nsxv3.common.synchronization [None req-a2e500da-24a2-4c44-a34a-e0aadbdf8a73 None None] Enqueued Resource ID: 0260898e-5fa4-4e90-ac79-f3b0e7a00a82 with Priority: HIGHEST for action port [ 683.418405] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0260898e-5fa4-4e90-ac79-f3b0e7a00a82 with Priority: HIGHEST for action port [ 683.418590] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-0260898e-5fa4-4e90-ac79-f3b0e7a00a82 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.418652] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0260898e-5fa4-4e90-ac79-f3b0e7a00a82" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.418713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0260898e-5fa4-4e90-ac79-f3b0e7a00a82" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.419492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0260898e-5fa4-4e90-ac79-f3b0e7a00a82" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.419492] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0260898e-5fa4-4e90-ac79-f3b0e7a00a82',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.485173] env[69647]: INFO networking_nsxv3.common.synchronization [req-3b72009c-8d3b-49a1-8a59-7dfc8e4334ee req-c69e13a9-674f-4d49-9255-37c45539b8f0 tempest-ServersAdminNegativeTestJSON-19627888 tempest-ServersAdminNegativeTestJSON-19627888-project-member] Enqueued Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 683.485173] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 683.486338] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.486338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.486338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.486338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.486338] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.486338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.486338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.489622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.489807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.489860] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.714831] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.715567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.715567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.715567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.715567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.715567] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b0174ed-5027-41e3-bf0c-6641441c40ec already deleted. [ 683.715821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b0174ed-5027-41e3-bf0c-6641441c40ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.748218] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: SUCCESS [ 683.748218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.748218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.748218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.748218] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.748218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.748218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.748218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.748218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.748218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.748218] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.908532] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.910008] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.910218] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.914020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.914020] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.914020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.914020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.914020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.914020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.914020] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.914020] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.914020] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.914020] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.914705] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.914705] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.914705] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.920964] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0260898e-5fa4-4e90-ac79-f3b0e7a00a82 [ 683.921269] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.921961] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.922119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.922408] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.922790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.922932] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0260898e-5fa4-4e90-ac79-f3b0e7a00a82 already deleted. [ 683.923089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0260898e-5fa4-4e90-ac79-f3b0e7a00a82" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.934804] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.934998] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 683.935211] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.935384] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.938763] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-dcbfbee2-72c5-424a-b266-5017d775f721 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.938763] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-dcbfbee2-72c5-424a-b266-5017d775f721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.938763] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-dcbfbee2-72c5-424a-b266-5017d775f721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.938763] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-dcbfbee2-72c5-424a-b266-5017d775f721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.938763] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcbfbee2-72c5-424a-b266-5017d775f721',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.993827] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.251951] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.252138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.252212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.252539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.252651] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.252766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.252840] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.253089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.253142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.253198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.253350] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.253444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.253503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.253651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.254496] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.254715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.254715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.254853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.254909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.255125] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.255335] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.419769] env[69647]: INFO networking_nsxv3.common.synchronization [None req-d7d17091-c73a-44f1-af1c-a615fe29886c None None] Enqueued Resource ID: 9df463f8-33b9-4afb-820c-f24cc6f1a8c9 with Priority: HIGHEST for action port [ 684.420054] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9df463f8-33b9-4afb-820c-f24cc6f1a8c9 with Priority: HIGHEST for action port [ 684.420644] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-9df463f8-33b9-4afb-820c-f24cc6f1a8c9 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.420797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9df463f8-33b9-4afb-820c-f24cc6f1a8c9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.420868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9df463f8-33b9-4afb-820c-f24cc6f1a8c9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.422880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9df463f8-33b9-4afb-820c-f24cc6f1a8c9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.422978] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9df463f8-33b9-4afb-820c-f24cc6f1a8c9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.442510] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.442510] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.442510] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.442510] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.442510] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.442510] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port dcbfbee2-72c5-424a-b266-5017d775f721 not found, creating... [ 684.442510] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.442510] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.442510] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.443105] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.443105] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.443105] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.443254] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.443382] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.443537] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.443673] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.443812] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: dcbfbee2-72c5-424a-b266-5017d775f721 is going to be created. [ 684.465104] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.465391] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.465515] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.466433] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.471020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.471020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-dcbfbee2-72c5-424a-b266-5017d775f721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.496198] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.758684] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25192273-bc3e-4f3a-9543-1ed380b4ef9b: rpc.has_security_group_logging(os_id): False [ 684.781445] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.781445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.781445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.781445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.781445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.781445] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.781445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.781445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.781445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.781445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.781445] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.781445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.781445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.781445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.782016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.782016] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.782016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.782016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.782016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.782248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.782395] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b is going to be updated. [ 684.850281] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.850428] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.850500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.850888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.851034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.864229] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: IN_PROGRESS for 2s [ 684.927028] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9df463f8-33b9-4afb-820c-f24cc6f1a8c9 [ 684.927276] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.928522] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.928648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.928860] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.928956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.929082] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9df463f8-33b9-4afb-820c-f24cc6f1a8c9 already deleted. [ 684.929167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9df463f8-33b9-4afb-820c-f24cc6f1a8c9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.998340] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.998340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.998340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.998340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.998340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.998340] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9c01b37-5156-42f7-b415-81d83f30f935 is going to be updated. [ 685.030201] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.031198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.031198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.031624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.033023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.044704] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: IN_PROGRESS for 2s [ 685.489687] env[69647]: INFO networking_nsxv3.common.synchronization [req-3b72009c-8d3b-49a1-8a59-7dfc8e4334ee req-1c29f237-b07b-42bc-bbec-d1981f54a0a3 service nova] Enqueued Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_rules [ 685.489687] env[69647]: INFO networking_nsxv3.common.synchronization [req-3b72009c-8d3b-49a1-8a59-7dfc8e4334ee req-1c29f237-b07b-42bc-bbec-d1981f54a0a3 service nova] Enqueued Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 685.489687] env[69647]: INFO networking_nsxv3.common.synchronization [req-3b72009c-8d3b-49a1-8a59-7dfc8e4334ee req-1c29f237-b07b-42bc-bbec-d1981f54a0a3 service nova] Enqueued Resource ID: dcbfbee2-72c5-424a-b266-5017d775f721 with Priority: HIGHEST for action port [ 685.489687] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_rules [ 685.489687] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 685.489687] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcbfbee2-72c5-424a-b266-5017d775f721 with Priority: HIGHEST for action port [ 685.489687] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.489687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.489687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.489687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.489687] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.490911] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.491038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.491351] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcbfbee2-72c5-424a-b266-5017d775f721 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.491429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcbfbee2-72c5-424a-b266-5017d775f721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.491503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcbfbee2-72c5-424a-b266-5017d775f721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.491707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcbfbee2-72c5-424a-b266-5017d775f721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.491806] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcbfbee2-72c5-424a-b266-5017d775f721',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.840913] env[69647]: INFO networking_nsxv3.common.synchronization [req-046bd3ef-ee08-4709-9799-ce8a793a0007 req-760de412-104f-413b-bae8-8343e9d2610b tempest-FloatingIPsAssociationNegativeTestJSON-1852455983 tempest-FloatingIPsAssociationNegativeTestJSON-1852455983-project-member] Enqueued Resource ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 with Priority: HIGHEST for action security_group_members [ 685.840913] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 with Priority: HIGHEST for action security_group_members [ 685.840913] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.840913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.840913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.840913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.840913] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.840913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.840913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.840913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.841572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.841572] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92008a16-dbb6-4fa9-bbfd-5faf35617bb1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.993494] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.993494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.997036] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcbfbee2-72c5-424a-b266-5017d775f721 with status ACTIVE [ 685.997036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.997036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.997036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.997036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.997036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.997036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.997036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.997036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.997036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.997036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.997036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.997596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.997596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.997596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.997596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.997596] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcbfbee2-72c5-424a-b266-5017d775f721 is going to be updated. [ 686.019788] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.020415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.020512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.020743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.020897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.021449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcbfbee2-72c5-424a-b266-5017d775f721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.346277] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.346277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.346277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.346277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.346277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.347143] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.349044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.349044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.349044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.349044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.349044] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 is going to be updated. [ 686.381291] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.381908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.381908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.381908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.382155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.392203] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 in Status: IN_PROGRESS for 2s [ 686.876462] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: SUCCESS [ 686.876747] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.057536] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: SUCCESS [ 687.057536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.057536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.057536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.057536] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.057536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.057536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.057536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.057536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.057536] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.220570] env[69647]: INFO networking_nsxv3.common.synchronization [None req-329e7546-8f88-4dcd-97d2-99b76e82df23 None None] Enqueued Resource ID: 14321372-bcc5-41b4-ad13-6a4e1c131dee with Priority: HIGHEST for action port [ 687.221129] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14321372-bcc5-41b4-ad13-6a4e1c131dee with Priority: HIGHEST for action port [ 687.221430] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-14321372-bcc5-41b4-ad13-6a4e1c131dee taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.221551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14321372-bcc5-41b4-ad13-6a4e1c131dee" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.221619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14321372-bcc5-41b4-ad13-6a4e1c131dee" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.221864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14321372-bcc5-41b4-ad13-6a4e1c131dee" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.221947] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14321372-bcc5-41b4-ad13-6a4e1c131dee',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.523007] env[69647]: INFO networking_nsxv3.common.synchronization [req-a9494368-6a09-40b5-bfe6-72dba4995b04 req-3b4a9527-6f15-4c91-82f0-3bbb78f7a8c1 tempest-ImagesNegativeTestJSON-581848103 tempest-ImagesNegativeTestJSON-581848103-project-member] Enqueued Resource ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f with Priority: HIGHEST for action security_group_members [ 687.523781] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f with Priority: HIGHEST for action security_group_members [ 687.524163] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c879b90-76f3-430e-8b1f-ba2fe27e511f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.524876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.525181] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.525349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.525589] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.525757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.525875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.526113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.526442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.526639] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c879b90-76f3-430e-8b1f-ba2fe27e511f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.560997] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.726051] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14321372-bcc5-41b4-ad13-6a4e1c131dee [ 687.728189] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.728189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.728189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.728189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.728189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.728189] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14321372-bcc5-41b4-ad13-6a4e1c131dee already deleted. [ 687.728189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14321372-bcc5-41b4-ad13-6a4e1c131dee" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.029432] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.029780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.029780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.029857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.029947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.030296] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.030403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.030459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.030616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.030831] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.030831] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f is going to be updated. [ 688.062275] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.073456] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.073456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.073456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.073456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.073456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.082469] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f in Status: IN_PROGRESS for 2s [ 688.371359] env[69647]: INFO networking_nsxv3.common.synchronization [None req-f9a21cda-6e72-45a4-98a2-02d0c5ab41b9 None None] Enqueued Resource ID: 1787cf3a-8cc3-48c6-b8f1-6ce3f220f722 with Priority: HIGHEST for action port [ 688.371359] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1787cf3a-8cc3-48c6-b8f1-6ce3f220f722 with Priority: HIGHEST for action port [ 688.371359] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1787cf3a-8cc3-48c6-b8f1-6ce3f220f722 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.371359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1787cf3a-8cc3-48c6-b8f1-6ce3f220f722" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.371359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1787cf3a-8cc3-48c6-b8f1-6ce3f220f722" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.371359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1787cf3a-8cc3-48c6-b8f1-6ce3f220f722" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.371359] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1787cf3a-8cc3-48c6-b8f1-6ce3f220f722',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.401908] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 in Status: SUCCESS [ 688.401908] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92008a16-dbb6-4fa9-bbfd-5faf35617bb1 deletion is rescheduled due to dependency. [ 688.402088] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92008a16-dbb6-4fa9-bbfd-5faf35617bb1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.564614] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.564761] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.564832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.565068] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.565185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.565313] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9c01b37-5156-42f7-b415-81d83f30f935 is going to be updated. [ 688.591638] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.591803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.592567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.592793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.592952] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.604113] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: IN_PROGRESS for 2s [ 688.875403] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1787cf3a-8cc3-48c6-b8f1-6ce3f220f722 [ 688.875642] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.875785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.875844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.876083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.876176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.876272] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1787cf3a-8cc3-48c6-b8f1-6ce3f220f722 already deleted. [ 688.876353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1787cf3a-8cc3-48c6-b8f1-6ce3f220f722" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.552505] env[69647]: INFO networking_nsxv3.common.synchronization [None req-4cc36cf1-51c3-457e-b16b-38cfe2b16d71 None None] Enqueued Resource ID: f794068f-abc9-4b9b-8e3a-4df3192bb341 with Priority: HIGHEST for action port [ 689.553135] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f794068f-abc9-4b9b-8e3a-4df3192bb341 with Priority: HIGHEST for action port [ 689.553451] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-f794068f-abc9-4b9b-8e3a-4df3192bb341 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.553769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f794068f-abc9-4b9b-8e3a-4df3192bb341" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.553769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f794068f-abc9-4b9b-8e3a-4df3192bb341" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.559718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f794068f-abc9-4b9b-8e3a-4df3192bb341" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.559718] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f794068f-abc9-4b9b-8e3a-4df3192bb341',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.067628] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f794068f-abc9-4b9b-8e3a-4df3192bb341 [ 690.067867] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.068011] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.068084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.068300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.068385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.068478] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f794068f-abc9-4b9b-8e3a-4df3192bb341 already deleted. [ 690.068556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f794068f-abc9-4b9b-8e3a-4df3192bb341" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.089927] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f in Status: SUCCESS [ 690.090108] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f deletion is rescheduled due to dependency. [ 690.090221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.615513] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: SUCCESS [ 690.615783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.616017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.616211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.616407] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.616540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.616540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.616718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.616802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.616895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.616988] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.120690] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.120915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.121048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.121291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.121468] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.121569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.121633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.121839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.121944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.122050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.122220] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.122318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.122395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.122566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.122723] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.122795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.122857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.123010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.123087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.123170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.123261] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.223330] env[69647]: INFO networking_nsxv3.common.synchronization [None req-4756103b-2dbf-4cc6-bea9-b13c0e280d12 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_rules [ 691.223330] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_rules [ 691.223330] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df955150-4015-4c07-90e5-0a793c5a1b3b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.223330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.223330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.223330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.224359] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df955150-4015-4c07-90e5-0a793c5a1b3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.400460] env[69647]: INFO networking_nsxv3.common.synchronization [None req-424b8644-22aa-4498-8687-72e02bbea27e tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_rules [ 691.400460] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_rules [ 691.400460] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df955150-4015-4c07-90e5-0a793c5a1b3b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.400460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.518768] env[69647]: INFO networking_nsxv3.common.synchronization [None req-52b50299-77eb-40e7-931a-202553555f8b None None] Enqueued Resource ID: fe80accb-6bf5-4583-a03a-7a190276d4bd with Priority: HIGHEST for action port [ 691.518768] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe80accb-6bf5-4583-a03a-7a190276d4bd with Priority: HIGHEST for action port [ 691.519019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe80accb-6bf5-4583-a03a-7a190276d4bd taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.519019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe80accb-6bf5-4583-a03a-7a190276d4bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.519098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe80accb-6bf5-4583-a03a-7a190276d4bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.519341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe80accb-6bf5-4583-a03a-7a190276d4bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.519490] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe80accb-6bf5-4583-a03a-7a190276d4bd',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.628199] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9c01b37-5156-42f7-b415-81d83f30f935: rpc.has_security_group_logging(os_id): False [ 691.649135] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.649135] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.649135] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.649135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.649619] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.649619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.649619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.649619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.649619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.649747] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9c01b37-5156-42f7-b415-81d83f30f935 is going to be updated. [ 691.709036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.709239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.710317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.710317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.710317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.724355] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: IN_PROGRESS for 2s [ 691.742991] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.743169] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.743241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.743484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.743737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.743737] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df955150-4015-4c07-90e5-0a793c5a1b3b already deleted. [ 691.743865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.743965] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.745558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.745658] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df955150-4015-4c07-90e5-0a793c5a1b3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.023975] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe80accb-6bf5-4583-a03a-7a190276d4bd [ 692.023975] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.023975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.023975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.023975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.023975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.023975] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe80accb-6bf5-4583-a03a-7a190276d4bd already deleted. [ 692.023975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe80accb-6bf5-4583-a03a-7a190276d4bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.267344] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.267344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.267344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.267344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.267344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.267344] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df955150-4015-4c07-90e5-0a793c5a1b3b already deleted. [ 692.267344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.363638] env[69647]: INFO networking_nsxv3.common.synchronization [None req-8c61a326-31a5-4c17-a4a0-6bbfdc3e28c0 tempest-VolumesAdminNegativeTest-778557798 tempest-VolumesAdminNegativeTest-778557798-project-member] Enqueued Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_rules [ 692.364309] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_rules [ 692.364629] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.364763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.364831] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.365689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.365689] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.378678] env[69647]: INFO networking_nsxv3.common.synchronization [None req-4e31dfe2-ce68-42f0-b655-3754f8248a0a None None] Enqueued Resource ID: 15fcd2af-6307-4ed1-af3f-1a3387319397 with Priority: HIGHEST for action port [ 692.379299] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15fcd2af-6307-4ed1-af3f-1a3387319397 with Priority: HIGHEST for action port [ 692.379603] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-15fcd2af-6307-4ed1-af3f-1a3387319397 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.379715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15fcd2af-6307-4ed1-af3f-1a3387319397" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.379798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15fcd2af-6307-4ed1-af3f-1a3387319397" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.385124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15fcd2af-6307-4ed1-af3f-1a3387319397" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.385124] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15fcd2af-6307-4ed1-af3f-1a3387319397',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.533102] env[69647]: INFO networking_nsxv3.common.synchronization [None req-c5f8d52a-c617-4ce0-bdd3-59aca33f8600 None None] Enqueued Resource ID: 8387ed05-3873-4169-953b-c8f9ed5f125c with Priority: HIGHEST for action port [ 692.535686] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8387ed05-3873-4169-953b-c8f9ed5f125c with Priority: HIGHEST for action port [ 692.535686] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-8387ed05-3873-4169-953b-c8f9ed5f125c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.535686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8387ed05-3873-4169-953b-c8f9ed5f125c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.535686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8387ed05-3873-4169-953b-c8f9ed5f125c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.535686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8387ed05-3873-4169-953b-c8f9ed5f125c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.535686] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8387ed05-3873-4169-953b-c8f9ed5f125c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.730054] env[69647]: INFO networking_nsxv3.common.synchronization [None req-ab76c34a-bd5b-4347-b8e5-519c4fb97788 tempest-VolumesAdminNegativeTest-778557798 tempest-VolumesAdminNegativeTest-778557798-project-member] Enqueued Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_rules [ 692.730668] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_rules [ 692.731148] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.731148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.833357] env[69647]: INFO networking_nsxv3.common.synchronization [None req-b3248238-f2a2-4583-8773-56d717150897 None None] Enqueued Resource ID: 9073f7c3-c060-456c-bc7b-9ec3c201ef38 with Priority: HIGHEST for action port [ 692.833887] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9073f7c3-c060-456c-bc7b-9ec3c201ef38 with Priority: HIGHEST for action port [ 692.834209] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-9073f7c3-c060-456c-bc7b-9ec3c201ef38 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.834331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9073f7c3-c060-456c-bc7b-9ec3c201ef38" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.834393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9073f7c3-c060-456c-bc7b-9ec3c201ef38" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.834664] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9073f7c3-c060-456c-bc7b-9ec3c201ef38" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.834752] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9073f7c3-c060-456c-bc7b-9ec3c201ef38',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.888278] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15fcd2af-6307-4ed1-af3f-1a3387319397 [ 692.888385] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.892219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.892307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.892540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.892636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.892738] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15fcd2af-6307-4ed1-af3f-1a3387319397 already deleted. [ 692.892885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15fcd2af-6307-4ed1-af3f-1a3387319397" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.922494] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.922494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.922494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.925108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.925108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.925108] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e already deleted. [ 692.925108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.925108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.925108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.925108] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.038650] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8387ed05-3873-4169-953b-c8f9ed5f125c [ 693.038924] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.039096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.039161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.039371] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.039469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.039923] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8387ed05-3873-4169-953b-c8f9ed5f125c already deleted. [ 693.039923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8387ed05-3873-4169-953b-c8f9ed5f125c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.339476] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9073f7c3-c060-456c-bc7b-9ec3c201ef38 [ 693.340424] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.340424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.340424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.340424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.340760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.340760] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9073f7c3-c060-456c-bc7b-9ec3c201ef38 already deleted. [ 693.340760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9073f7c3-c060-456c-bc7b-9ec3c201ef38" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.445312] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.445640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.445640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.445889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.445942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.446079] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e already deleted. [ 693.446188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.740301] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: SUCCESS [ 693.740301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.710200] env[69647]: INFO networking_nsxv3.common.synchronization [None req-5800a61d-42e1-4038-942b-ecdedb0c720a None None] Enqueued Resource ID: db073482-05b4-4f73-8ecb-752c92e42b41 with Priority: HIGHEST for action port [ 694.710905] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db073482-05b4-4f73-8ecb-752c92e42b41 with Priority: HIGHEST for action port [ 694.712304] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-db073482-05b4-4f73-8ecb-752c92e42b41 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.712545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db073482-05b4-4f73-8ecb-752c92e42b41" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.712634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db073482-05b4-4f73-8ecb-752c92e42b41" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.712918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db073482-05b4-4f73-8ecb-752c92e42b41" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.713067] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db073482-05b4-4f73-8ecb-752c92e42b41',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.216928] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db073482-05b4-4f73-8ecb-752c92e42b41 [ 695.217248] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.217312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.217414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.217700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.217868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.218018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db073482-05b4-4f73-8ecb-752c92e42b41 already deleted. [ 695.219331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db073482-05b4-4f73-8ecb-752c92e42b41" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.466028] env[69647]: INFO networking_nsxv3.common.synchronization [None req-bfba46f6-4187-40f9-b3ec-cec7318cd075 None None] Enqueued Resource ID: b3e49dc7-14b4-4061-9a7b-3d35635e1f62 with Priority: HIGHEST for action port [ 695.466312] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e49dc7-14b4-4061-9a7b-3d35635e1f62 with Priority: HIGHEST for action port [ 695.466906] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3e49dc7-14b4-4061-9a7b-3d35635e1f62 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.467036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3e49dc7-14b4-4061-9a7b-3d35635e1f62" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.467102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3e49dc7-14b4-4061-9a7b-3d35635e1f62" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.467370] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3e49dc7-14b4-4061-9a7b-3d35635e1f62" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.467439] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3e49dc7-14b4-4061-9a7b-3d35635e1f62',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.690306] env[69647]: INFO networking_nsxv3.common.synchronization [None req-574475f0-4ab4-4a69-a5e5-9fbf5f7eca14 tempest-ServersTestFqdnHostnames-1719574557 tempest-ServersTestFqdnHostnames-1719574557-project-member] Enqueued Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_rules [ 695.690989] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_rules [ 695.691311] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.691477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.691535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.691774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.692108] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c1ac393-0d0d-48c1-adc3-b358d19ecbca',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.902163] env[69647]: INFO networking_nsxv3.common.synchronization [None req-05ef3e67-99de-47a7-a707-8b6d0e3c84ed tempest-ServersTestFqdnHostnames-1719574557 tempest-ServersTestFqdnHostnames-1719574557-project-member] Enqueued Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_rules [ 695.902616] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_rules [ 695.903234] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.903446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.972039] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3e49dc7-14b4-4061-9a7b-3d35635e1f62 [ 695.972039] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.972039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.972039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.972039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.972039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.972039] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3e49dc7-14b4-4061-9a7b-3d35635e1f62 already deleted. [ 695.972039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3e49dc7-14b4-4061-9a7b-3d35635e1f62" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.213985] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.214628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.214628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.214628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.214628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.214628] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca already deleted. [ 696.214835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.214835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.214962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.215059] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c1ac393-0d0d-48c1-adc3-b358d19ecbca',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.619535] env[69647]: INFO networking_nsxv3.common.synchronization [None req-e6df1fab-569b-4618-9e67-a4b2c3789db2 None None] Enqueued Resource ID: 419baf27-7173-4353-ab33-1215ca4a4ab9 with Priority: HIGHEST for action port [ 696.619535] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 419baf27-7173-4353-ab33-1215ca4a4ab9 with Priority: HIGHEST for action port [ 696.619535] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-419baf27-7173-4353-ab33-1215ca4a4ab9 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.619535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-419baf27-7173-4353-ab33-1215ca4a4ab9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.619535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-419baf27-7173-4353-ab33-1215ca4a4ab9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.619535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-419baf27-7173-4353-ab33-1215ca4a4ab9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.619535] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('419baf27-7173-4353-ab33-1215ca4a4ab9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.732883] env[69647]: INFO networking_nsxv3.common.synchronization [None req-3af49aed-b231-41a1-a71f-4504e2bdebcd None None] Enqueued Resource ID: 2b36f684-249b-4567-8b72-309bc64a5a49 with Priority: HIGHEST for action port [ 696.733175] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b36f684-249b-4567-8b72-309bc64a5a49 with Priority: HIGHEST for action port [ 696.734520] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.734656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.734722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.734929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.735030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.735253] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca already deleted. [ 696.735253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.735432] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b36f684-249b-4567-8b72-309bc64a5a49 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.735535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b36f684-249b-4567-8b72-309bc64a5a49" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.735589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b36f684-249b-4567-8b72-309bc64a5a49" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.735799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b36f684-249b-4567-8b72-309bc64a5a49" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.735883] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b36f684-249b-4567-8b72-309bc64a5a49',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.856892] env[69647]: INFO networking_nsxv3.common.synchronization [req-c8bed269-4a32-49f1-8cec-49ed61866209 req-95222b28-511f-40fc-b099-02d868ebdc30 tempest-ListImageFiltersTestJSON-89573635 tempest-ListImageFiltersTestJSON-89573635-project-member] Enqueued Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 696.858131] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 696.858131] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.858131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.860533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.860533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.860533] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.860533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.860533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.860533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.860533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.860533] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.122458] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 419baf27-7173-4353-ab33-1215ca4a4ab9 [ 697.122696] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.122841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.122912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.123255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.123355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.123455] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:419baf27-7173-4353-ab33-1215ca4a4ab9 already deleted. [ 697.123536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-419baf27-7173-4353-ab33-1215ca4a4ab9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.238053] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b36f684-249b-4567-8b72-309bc64a5a49 [ 697.239584] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.239584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.239584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.239584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.239584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.239584] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b36f684-249b-4567-8b72-309bc64a5a49 already deleted. [ 697.239584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b36f684-249b-4567-8b72-309bc64a5a49" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.362519] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.362675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.362748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.362964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.363075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.363272] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.363368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.363429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.363579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.363654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.363738] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a already deleted. [ 697.363887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.739427] env[69647]: INFO networking_nsxv3.common.synchronization [None req-ab20fef0-9390-47ae-8810-0f0224b50c86 None None] Enqueued Resource ID: 29b89823-c66b-4284-b0f4-1a47718dae88 with Priority: HIGHEST for action port [ 697.739963] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29b89823-c66b-4284-b0f4-1a47718dae88 with Priority: HIGHEST for action port [ 697.740294] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-29b89823-c66b-4284-b0f4-1a47718dae88 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.740417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29b89823-c66b-4284-b0f4-1a47718dae88" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.740484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29b89823-c66b-4284-b0f4-1a47718dae88" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.740723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29b89823-c66b-4284-b0f4-1a47718dae88" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.740828] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29b89823-c66b-4284-b0f4-1a47718dae88',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.807160] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.807160] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.807160] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.807160] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.807477] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.807556] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.807645] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.807909] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.808308] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.808511] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.808567] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.808672] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.808794] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.808904] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.809026] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.809598] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.828808] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.828985] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 697.829137] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.829306] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.829614] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-774370fc-a49c-4109-a1d7-affecb7d0010 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.829781] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-774370fc-a49c-4109-a1d7-affecb7d0010" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.829899] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-774370fc-a49c-4109-a1d7-affecb7d0010" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.830233] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-774370fc-a49c-4109-a1d7-affecb7d0010" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.830372] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('774370fc-a49c-4109-a1d7-affecb7d0010',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.245926] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29b89823-c66b-4284-b0f4-1a47718dae88 [ 698.246084] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.246430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.246430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.246991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.247595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.247630] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29b89823-c66b-4284-b0f4-1a47718dae88 already deleted. [ 698.248161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29b89823-c66b-4284-b0f4-1a47718dae88" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.333051] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.333166] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.334176] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.334176] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.334176] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.334176] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 774370fc-a49c-4109-a1d7-affecb7d0010 not found, creating... [ 698.334346] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.334426] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.334506] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.334787] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.334974] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.335318] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.335484] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.335640] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.335892] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.335988] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.336445] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 774370fc-a49c-4109-a1d7-affecb7d0010 is going to be created. [ 698.357442] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.357442] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.357633] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.358639] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.358930] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.359268] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-774370fc-a49c-4109-a1d7-affecb7d0010" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.546755] env[69647]: INFO networking_nsxv3.common.synchronization [req-a4c9a539-c042-486a-9898-a4b14399faef req-69b46052-3590-4078-bc75-f956eac1bcd1 tempest-ListImageFiltersTestJSON-89573635 tempest-ListImageFiltersTestJSON-89573635-project-member] Enqueued Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 698.547293] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 698.547588] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.548100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.548171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.548421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.548586] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.548694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.548782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.548913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.548992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.549234] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.621820] env[69647]: INFO networking_nsxv3.common.synchronization [None req-1e66c8a6-25ec-40ee-aedb-a6166a2d33bd None None] Enqueued Resource ID: 6eed2cbf-cc72-497f-85d2-761be89ce816 with Priority: HIGHEST for action port [ 698.622111] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eed2cbf-cc72-497f-85d2-761be89ce816 with Priority: HIGHEST for action port [ 698.622662] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eed2cbf-cc72-497f-85d2-761be89ce816 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.622788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eed2cbf-cc72-497f-85d2-761be89ce816" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.622859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eed2cbf-cc72-497f-85d2-761be89ce816" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.623500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eed2cbf-cc72-497f-85d2-761be89ce816" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.623500] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eed2cbf-cc72-497f-85d2-761be89ce816',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.841230] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.841586] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.841586] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.842490] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.842490] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.842490] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.842490] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.842874] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.842874] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.843077] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.843650] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.843650] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.843650] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.843650] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.843893] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.843983] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.862240] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.862421] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.862536] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.862738] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.863073] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1e7c5e98-cc86-4bfd-83f9-5b3c287210b2 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.863261] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1e7c5e98-cc86-4bfd-83f9-5b3c287210b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.863379] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1e7c5e98-cc86-4bfd-83f9-5b3c287210b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.863724] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1e7c5e98-cc86-4bfd-83f9-5b3c287210b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.863886] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e7c5e98-cc86-4bfd-83f9-5b3c287210b2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.052618] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.052704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.052789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.053022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.053095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.053327] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.053421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.055483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.055483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.055483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.055483] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a already deleted. [ 699.055483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.129414] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6eed2cbf-cc72-497f-85d2-761be89ce816 [ 699.129701] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.129851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.129987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.130256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.130349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.130448] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6eed2cbf-cc72-497f-85d2-761be89ce816 already deleted. [ 699.130549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eed2cbf-cc72-497f-85d2-761be89ce816" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.368855] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.369111] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.369244] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.369534] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.369681] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.369864] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1e7c5e98-cc86-4bfd-83f9-5b3c287210b2 not found, creating... [ 699.370190] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.370358] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.370692] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.371101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.371204] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.371492] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.371691] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.371765] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.371995] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.372214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.372277] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1e7c5e98-cc86-4bfd-83f9-5b3c287210b2 is going to be created. [ 699.392313] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.392507] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.392670] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.392863] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.393125] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.393376] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1e7c5e98-cc86-4bfd-83f9-5b3c287210b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.456786] env[69647]: INFO networking_nsxv3.common.synchronization [req-c8bed269-4a32-49f1-8cec-49ed61866209 req-f8d1bbe2-dd10-494c-ab45-5baced768e3a service nova] Enqueued Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_rules [ 699.456786] env[69647]: INFO networking_nsxv3.common.synchronization [req-c8bed269-4a32-49f1-8cec-49ed61866209 req-f8d1bbe2-dd10-494c-ab45-5baced768e3a service nova] Enqueued Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 699.456786] env[69647]: INFO networking_nsxv3.common.synchronization [req-c8bed269-4a32-49f1-8cec-49ed61866209 req-f8d1bbe2-dd10-494c-ab45-5baced768e3a service nova] Enqueued Resource ID: 774370fc-a49c-4109-a1d7-affecb7d0010 with Priority: HIGHEST for action port [ 699.456786] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_rules [ 699.456786] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 699.456786] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 774370fc-a49c-4109-a1d7-affecb7d0010 with Priority: HIGHEST for action port [ 699.456786] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.456786] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.456786] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.456786] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.456786] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.460674] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.460870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.460953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.461185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.461351] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.461453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.461748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.462010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.462193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.462193] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.462989] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-774370fc-a49c-4109-a1d7-affecb7d0010 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.463129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-774370fc-a49c-4109-a1d7-affecb7d0010" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.463207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-774370fc-a49c-4109-a1d7-affecb7d0010" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.463365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-774370fc-a49c-4109-a1d7-affecb7d0010" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.463440] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('774370fc-a49c-4109-a1d7-affecb7d0010',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.969702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.969702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.969702] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.969702] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 774370fc-a49c-4109-a1d7-affecb7d0010 with status ACTIVE [ 699.969702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.969702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.969702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.969702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.969702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.969702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.969702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.969702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.969702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.969702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.970426] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.970426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.970426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.970426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.970426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.970426] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 774370fc-a49c-4109-a1d7-affecb7d0010 is going to be updated. [ 699.993953] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.994158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.994789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.994789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.994789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.994789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-774370fc-a49c-4109-a1d7-affecb7d0010" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.123206] env[69647]: INFO networking_nsxv3.common.synchronization [req-a4c9a539-c042-486a-9898-a4b14399faef req-7202c00c-6d14-4ac7-9851-f018c216586d service nova] Enqueued Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_rules [ 700.123353] env[69647]: INFO networking_nsxv3.common.synchronization [req-a4c9a539-c042-486a-9898-a4b14399faef req-7202c00c-6d14-4ac7-9851-f018c216586d service nova] Enqueued Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 700.123489] env[69647]: INFO networking_nsxv3.common.synchronization [req-a4c9a539-c042-486a-9898-a4b14399faef req-7202c00c-6d14-4ac7-9851-f018c216586d service nova] Enqueued Resource ID: 1e7c5e98-cc86-4bfd-83f9-5b3c287210b2 with Priority: HIGHEST for action port [ 700.123717] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_rules [ 700.125055] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 700.125055] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e7c5e98-cc86-4bfd-83f9-5b3c287210b2 with Priority: HIGHEST for action port [ 700.125055] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.125055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.125055] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.125055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.125670] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e7c5e98-cc86-4bfd-83f9-5b3c287210b2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.125670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e7c5e98-cc86-4bfd-83f9-5b3c287210b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.125670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e7c5e98-cc86-4bfd-83f9-5b3c287210b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.125670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e7c5e98-cc86-4bfd-83f9-5b3c287210b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.125670] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e7c5e98-cc86-4bfd-83f9-5b3c287210b2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.475402] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.627945] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e7c5e98-cc86-4bfd-83f9-5b3c287210b2 with status ACTIVE [ 700.628453] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.628604] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.628677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.628920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.629017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.629205] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.629301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.629361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.629510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.630500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.630910] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.631100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.631307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.631691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.631972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.632123] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e7c5e98-cc86-4bfd-83f9-5b3c287210b2 is going to be updated. [ 700.655507] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.655507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.655680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.656305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.656305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.656305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e7c5e98-cc86-4bfd-83f9-5b3c287210b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.977690] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.978010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.978010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.978107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.978193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.978296] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a is going to be created. [ 701.000451] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.000592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.000661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.000958] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.001214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.014091] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: UNINITIALIZED for 2s [ 703.022283] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: SUCCESS [ 703.022826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.023355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.023355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.023691] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.023877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.023907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.024098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.024162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.024253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.024509] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.025814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.025814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.025814] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.026072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.026072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.026072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.026162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.026214] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.101549] env[69647]: INFO networking_nsxv3.common.synchronization [req-2d46603d-9027-40ed-8231-2b1cde357089 req-7625644b-a22e-4f13-a926-0a75eb4b5ac9 tempest-AttachInterfacesV270Test-1863027340 tempest-AttachInterfacesV270Test-1863027340-project-member] Enqueued Resource ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 with Priority: HIGHEST for action security_group_members [ 703.103088] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 with Priority: HIGHEST for action security_group_members [ 703.103602] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e6d13e-7877-4688-9ade-504a1a3d2a71 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.103899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.103899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.104485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.104485] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.104485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.104485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.104696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.104696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.104696] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e6d13e-7877-4688-9ade-504a1a3d2a71',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.424904] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-800 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.425690] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-800" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.425690] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-800" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.425690] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-800" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.425806] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.426266] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.426266] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.427030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.427134] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.427888] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.428026] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.428137] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.428854] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.428854] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.428854] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.428854] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.449943] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.450137] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 703.450275] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.450450] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-800" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.450775] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-9874b805-8ee4-49aa-9f11-e2a50dad7e4f taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.451138] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-9874b805-8ee4-49aa-9f11-e2a50dad7e4f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.451302] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-9874b805-8ee4-49aa-9f11-e2a50dad7e4f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.451609] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-9874b805-8ee4-49aa-9f11-e2a50dad7e4f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.451753] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9874b805-8ee4-49aa-9f11-e2a50dad7e4f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.529112] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.529112] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.529112] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.607392] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.612209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.612209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.612209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.612209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.612209] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.612209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.612209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.612209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.612209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.612209] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 already deleted. [ 703.612209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.959605] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.959605] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.959605] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.959605] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.959605] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.959605] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 9874b805-8ee4-49aa-9f11-e2a50dad7e4f not found, creating... [ 703.959605] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.959605] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.959605] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.959605] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.959605] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.962940] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.962940] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.962940] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.962940] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.962940] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.962940] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 9874b805-8ee4-49aa-9f11-e2a50dad7e4f is going to be created. [ 703.979416] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.979628] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.979754] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.980058] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.980278] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.980505] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-9874b805-8ee4-49aa-9f11-e2a50dad7e4f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.031503] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.534549] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.534806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.534941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.535250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.535443] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.535593] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a is going to be updated. [ 704.570758] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.571011] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.571079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.571313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.571459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.580882] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: IN_PROGRESS for 2s [ 705.078763] env[69647]: INFO networking_nsxv3.common.synchronization [req-2d46603d-9027-40ed-8231-2b1cde357089 req-113e868a-4f2b-49e6-9879-df7258e16653 service nova] Enqueued Resource ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 with Priority: HIGHEST for action security_group_rules [ 705.079012] env[69647]: INFO networking_nsxv3.common.synchronization [req-2d46603d-9027-40ed-8231-2b1cde357089 req-113e868a-4f2b-49e6-9879-df7258e16653 service nova] Enqueued Resource ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 with Priority: HIGHEST for action security_group_members [ 705.079117] env[69647]: INFO networking_nsxv3.common.synchronization [req-2d46603d-9027-40ed-8231-2b1cde357089 req-113e868a-4f2b-49e6-9879-df7258e16653 service nova] Enqueued Resource ID: 9874b805-8ee4-49aa-9f11-e2a50dad7e4f with Priority: HIGHEST for action port [ 705.079547] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 with Priority: HIGHEST for action security_group_rules [ 705.079677] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 with Priority: HIGHEST for action security_group_members [ 705.079771] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9874b805-8ee4-49aa-9f11-e2a50dad7e4f with Priority: HIGHEST for action port [ 705.083660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90e6d13e-7877-4688-9ade-504a1a3d2a71 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.083660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.083660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.083660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.083660] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90e6d13e-7877-4688-9ade-504a1a3d2a71',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.083660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e6d13e-7877-4688-9ade-504a1a3d2a71 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.083660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.083660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.083660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.083660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.083660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.083660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.084135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.084135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.084135] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e6d13e-7877-4688-9ade-504a1a3d2a71',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.087113] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-9874b805-8ee4-49aa-9f11-e2a50dad7e4f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.087113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9874b805-8ee4-49aa-9f11-e2a50dad7e4f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.087113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9874b805-8ee4-49aa-9f11-e2a50dad7e4f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.087113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9874b805-8ee4-49aa-9f11-e2a50dad7e4f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.087113] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9874b805-8ee4-49aa-9f11-e2a50dad7e4f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.215588] env[69647]: INFO networking_nsxv3.common.synchronization [None req-b97d7b85-a7e3-4cd7-90ee-0b2a7e634690 None None] Enqueued Resource ID: 3e074032-cc02-4c21-98dd-c6c768e9de27 with Priority: HIGHEST for action port [ 705.215871] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e074032-cc02-4c21-98dd-c6c768e9de27 with Priority: HIGHEST for action port [ 705.216441] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e074032-cc02-4c21-98dd-c6c768e9de27 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.216722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e074032-cc02-4c21-98dd-c6c768e9de27" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.216722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e074032-cc02-4c21-98dd-c6c768e9de27" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.216887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e074032-cc02-4c21-98dd-c6c768e9de27" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.216972] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e074032-cc02-4c21-98dd-c6c768e9de27',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.588632] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e6d13e-7877-4688-9ade-504a1a3d2a71 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.588889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.589118] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90e6d13e-7877-4688-9ade-504a1a3d2a71',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.592324] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9874b805-8ee4-49aa-9f11-e2a50dad7e4f with status ACTIVE [ 705.592525] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.592646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.592715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.592921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.593017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.593226] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.593289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.593467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.593536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.593536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.593726] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.593819] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.593882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.594335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.594515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.594622] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9874b805-8ee4-49aa-9f11-e2a50dad7e4f is going to be updated. [ 705.613523] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.613523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.613523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.613523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.613719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.613801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9874b805-8ee4-49aa-9f11-e2a50dad7e4f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.623165] env[69647]: INFO networking_nsxv3.common.synchronization [req-a9663b19-88d3-4010-b43a-f447417aba3b req-b4ae8f80-184e-4b8d-ae59-b5f502c23453 tempest-FloatingIPsAssociationTestJSON-597742564 tempest-FloatingIPsAssociationTestJSON-597742564-project-member] Enqueued Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 705.624503] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 705.624848] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.624972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.625030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.625223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.625397] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.625494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.625554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.625696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.625773] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.627099] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.721183] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e074032-cc02-4c21-98dd-c6c768e9de27 [ 705.722291] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.722291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.722291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.722291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.722291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.722291] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e074032-cc02-4c21-98dd-c6c768e9de27 already deleted. [ 705.722291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e074032-cc02-4c21-98dd-c6c768e9de27" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.096409] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90e6d13e-7877-4688-9ade-504a1a3d2a71',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.130253] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.475224] env[69647]: INFO networking_nsxv3.common.synchronization [req-390d6f83-4889-49ce-8d4c-d8ec9b66abf5 req-6cab3598-1357-4f85-ac07-a4469e648ed9 tempest-ServerActionsTestOtherB-626642147 tempest-ServerActionsTestOtherB-626642147-project-member] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 706.477114] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 706.477755] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.477934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.478089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.478396] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.478637] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.479157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.479265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.479570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.479709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.479987] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.593155] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: SUCCESS [ 706.593641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.593889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.594507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.594749] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.595192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.595192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.595192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.595304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.595382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.595546] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.596377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.596521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.596721] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.596921] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.597086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.597182] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.597554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.597554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.597554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.597705] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.599924] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.600154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.600154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.600280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.600357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.600450] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 is going to be created. [ 706.623176] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.623347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.623404] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.623824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.623824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.632346] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 in Status: UNINITIALIZED for 2s [ 706.632780] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.985457] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.985457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.985457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.985457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.985457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.985457] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.985457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.985457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.985457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.985457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.985457] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 already deleted. [ 706.985457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.034839] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.034839] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.034839] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.034839] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.035085] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.035387] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.035558] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.035899] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.036092] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.036332] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 707.036467] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.036607] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.036735] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.036863] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 707.036987] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.037153] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.055045] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.055221] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 707.055834] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.055834] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.055834] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-56e528e3-c1a8-48c7-9e06-4b727ff767af taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.056070] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-56e528e3-c1a8-48c7-9e06-4b727ff767af" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.056117] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-56e528e3-c1a8-48c7-9e06-4b727ff767af" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.056433] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-56e528e3-c1a8-48c7-9e06-4b727ff767af" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.056593] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56e528e3-c1a8-48c7-9e06-4b727ff767af',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.103894] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a: rpc.has_security_group_logging(os_id): False [ 707.133590] env[69647]: INFO networking_nsxv3.common.synchronization [None req-419b4397-3bcf-47af-92ae-9df588e436da None None] Enqueued Resource ID: 1738cf8a-94b7-4fa9-8be1-e7aacd21e44a with Priority: HIGHEST for action port [ 707.133590] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.133590] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.133750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.134086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.134086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.134283] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.134881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.134881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.135193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.135193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.135378] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.135437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.135504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.135816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.135816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.135957] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.136835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.136835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.136835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.136835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.136835] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a is going to be created. [ 707.140435] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1738cf8a-94b7-4fa9-8be1-e7aacd21e44a with Priority: HIGHEST for action port [ 707.140435] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.140435] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.140435] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.140435] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.140435] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.140435] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b is going to be updated. [ 707.141196] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1738cf8a-94b7-4fa9-8be1-e7aacd21e44a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.141314] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1738cf8a-94b7-4fa9-8be1-e7aacd21e44a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.141436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1738cf8a-94b7-4fa9-8be1-e7aacd21e44a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.141653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1738cf8a-94b7-4fa9-8be1-e7aacd21e44a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.141653] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1738cf8a-94b7-4fa9-8be1-e7aacd21e44a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.183791] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.183914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.183983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.185034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.185034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.202343] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: IN_PROGRESS for 2s [ 707.246323] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.246483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.246562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.247292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.247292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.260226] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: IN_PROGRESS for 2s [ 707.562116] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.562116] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.562116] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.562116] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.562483] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.562936] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 56e528e3-c1a8-48c7-9e06-4b727ff767af not found, creating... [ 707.563279] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.563459] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.563578] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.563805] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.564097] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.564554] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.564720] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.564857] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.565109] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.565620] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.565620] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 56e528e3-c1a8-48c7-9e06-4b727ff767af is going to be created. [ 707.584212] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.584436] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.584549] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.584813] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.585055] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.585282] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-56e528e3-c1a8-48c7-9e06-4b727ff767af" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.646436] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1738cf8a-94b7-4fa9-8be1-e7aacd21e44a [ 707.646663] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.646820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.646894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.647139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.647232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.647420] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1738cf8a-94b7-4fa9-8be1-e7aacd21e44a already deleted. [ 707.647450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1738cf8a-94b7-4fa9-8be1-e7aacd21e44a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.313898] env[69647]: INFO networking_nsxv3.common.synchronization [req-86dba513-cc13-4154-b03e-b19fc882c87a req-33df7021-695a-42d2-bee0-afb946cc6bf6 tempest-ServerMetadataTestJSON-1717528321 tempest-ServerMetadataTestJSON-1717528321-project-member] Enqueued Resource ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 with Priority: HIGHEST for action security_group_members [ 708.314430] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 with Priority: HIGHEST for action security_group_members [ 708.314734] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.314858] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.314930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.317583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.317786] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.317964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.318065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.318170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.318259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.318374] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7089450c-93b7-4d5b-bc9f-a1a19b5783e0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.423327] env[69647]: INFO networking_nsxv3.common.synchronization [req-390d6f83-4889-49ce-8d4c-d8ec9b66abf5 req-16141e9b-8d89-422b-b1f2-15894a05f859 service nova] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 708.423502] env[69647]: INFO networking_nsxv3.common.synchronization [req-390d6f83-4889-49ce-8d4c-d8ec9b66abf5 req-16141e9b-8d89-422b-b1f2-15894a05f859 service nova] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 708.423673] env[69647]: INFO networking_nsxv3.common.synchronization [req-390d6f83-4889-49ce-8d4c-d8ec9b66abf5 req-16141e9b-8d89-422b-b1f2-15894a05f859 service nova] Enqueued Resource ID: 56e528e3-c1a8-48c7-9e06-4b727ff767af with Priority: HIGHEST for action port [ 708.424420] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 708.425082] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 708.425253] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56e528e3-c1a8-48c7-9e06-4b727ff767af with Priority: HIGHEST for action port [ 708.425554] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.425679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.425763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.425997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.426094] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.428165] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.429178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.429178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.429178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.429178] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.429178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.429178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.429178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.429178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.429178] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.432497] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-56e528e3-c1a8-48c7-9e06-4b727ff767af taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.432497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56e528e3-c1a8-48c7-9e06-4b727ff767af" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.432497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56e528e3-c1a8-48c7-9e06-4b727ff767af" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.432497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56e528e3-c1a8-48c7-9e06-4b727ff767af" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.432497] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56e528e3-c1a8-48c7-9e06-4b727ff767af',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.647909] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 in Status: SUCCESS [ 708.647909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.647909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.647909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.647909] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.647909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.647909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.647909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.647909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.647909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.647909] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90e6d13e-7877-4688-9ade-504a1a3d2a71',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.820121] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.820289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.820360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.820584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.820678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.820928] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.821066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.821122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.821278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.821351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.821442] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 is going to be updated. [ 708.850148] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.850148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.850148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.850148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.850148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.857795] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 in Status: IN_PROGRESS for 2s [ 708.929377] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.929377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.933459] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.933459] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56e528e3-c1a8-48c7-9e06-4b727ff767af with status ACTIVE [ 708.933459] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.933459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.933459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.933459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.933459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.935620] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.935620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.935620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.935620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.935620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.935620] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.935620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.935620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.935620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.935620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.935620] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56e528e3-c1a8-48c7-9e06-4b727ff767af is going to be updated. [ 708.957034] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.957034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.957034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.957034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.957034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.957471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56e528e3-c1a8-48c7-9e06-4b727ff767af" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.152609] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e6d13e-7877-4688-9ade-504a1a3d2a71 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.152609] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.152609] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e6d13e-7877-4688-9ade-504a1a3d2a71 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.152609] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.152609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.153577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.153577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.153577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.153577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.153577] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90e6d13e-7877-4688-9ade-504a1a3d2a71',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.211365] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: SUCCESS [ 709.211597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.314018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: SUCCESS [ 709.315573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.315573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.315573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.315573] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.436008] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.658468] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90e6d13e-7877-4688-9ade-504a1a3d2a71: rpc.has_security_group_logging(os_id): False [ 709.678538] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.678690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.678820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.679057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.679186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.679330] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.679428] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.679491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.679665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.679742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.679930] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.680042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.680106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.680247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.680354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.680502] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.680596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.680657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.680798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.680937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.681383] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 is going to be created. [ 709.733738] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.733879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.733957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.734188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.734358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.744111] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 in Status: IN_PROGRESS for 2s [ 709.822147] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.822315] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.822390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.822611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.822779] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.822886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.822954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.823134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.823242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.823334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.823419] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.939821] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.939952] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.940040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.940272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.940365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.940467] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be created. [ 709.962736] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.962882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.962938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.963167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.963333] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.973131] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: UNINITIALIZED for 2s [ 710.327113] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.327113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.327113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.327113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.327113] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.327113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.327113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.327946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.327946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.327946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.327946] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.327946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.327946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.327946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.328153] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.328153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.328153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.329120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.329120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.329120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.329120] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.831291] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a: rpc.has_security_group_logging(os_id): False [ 710.851044] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.851044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.851044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.851044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.851044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.851044] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.851044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.851044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.851044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.851044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.853097] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.854021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.854021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.854021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.854021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.854021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.854349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.854481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.854706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.854891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.855071] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a is going to be updated. [ 710.865798] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 in Status: SUCCESS [ 710.865798] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 deletion is rescheduled due to dependency. [ 710.865798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.918025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.918025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.918025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.918025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.918025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.931724] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: IN_PROGRESS for 2s [ 711.078866] env[69647]: INFO networking_nsxv3.common.synchronization [req-e28a1d68-d102-4bfb-b91e-bf3ef94da239 req-da1958ca-493d-41c7-9911-a4251c73f857 tempest-ServersAdminNegativeTestJSON-19627888 tempest-ServersAdminNegativeTestJSON-19627888-project-member] Enqueued Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 711.080037] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 711.080682] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.083031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.083031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.083031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.083031] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.083031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.083031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.083031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.083031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.083031] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.587517] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.758477] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 in Status: SUCCESS [ 711.758477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.984037] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 711.984037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.984214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.984444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.984671] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.984888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.984976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.985179] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.985264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.985354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.985448] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.091099] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.316397] env[69647]: INFO networking_nsxv3.common.synchronization [None req-05d3cfbe-47b4-4d1e-9d72-3e61580d690d None None] Enqueued Resource ID: bd57da80-9ffc-4205-8f2e-3a6bad3264f3 with Priority: HIGHEST for action port [ 712.317171] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd57da80-9ffc-4205-8f2e-3a6bad3264f3 with Priority: HIGHEST for action port [ 712.317704] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd57da80-9ffc-4205-8f2e-3a6bad3264f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.317704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd57da80-9ffc-4205-8f2e-3a6bad3264f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.317850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd57da80-9ffc-4205-8f2e-3a6bad3264f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.318224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd57da80-9ffc-4205-8f2e-3a6bad3264f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.318224] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd57da80-9ffc-4205-8f2e-3a6bad3264f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.488583] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.560303] env[69647]: INFO networking_nsxv3.common.synchronization [None req-12490ea7-9189-4bdb-97b8-bb74a8a0deb9 tempest-ServerActionsV293TestJSON-654612076 tempest-ServerActionsV293TestJSON-654612076-project-member] Enqueued Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_rules [ 712.560850] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_rules [ 712.560974] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.561834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.561834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.561834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.561834] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.593972] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.594474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.594474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.594474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.594566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.594694] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9c01b37-5156-42f7-b415-81d83f30f935 is going to be updated. [ 712.622286] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.622436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.622499] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.622752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.622902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.633909] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: IN_PROGRESS for 2s [ 712.645768] env[69647]: INFO networking_nsxv3.common.synchronization [None req-3685ba47-1feb-4cfd-ac24-b12aaa483842 tempest-ServerActionsV293TestJSON-654612076 tempest-ServerActionsV293TestJSON-654612076-project-member] Enqueued Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_rules [ 712.646089] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_rules [ 712.646376] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.646567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.822369] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd57da80-9ffc-4205-8f2e-3a6bad3264f3 [ 712.822369] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.822369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.822369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.822369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.822369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.822369] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd57da80-9ffc-4205-8f2e-3a6bad3264f3 already deleted. [ 712.822369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd57da80-9ffc-4205-8f2e-3a6bad3264f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.950973] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: SUCCESS [ 712.951276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.993045] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c35014e-8d95-4c20-872d-da537d220b20: rpc.has_security_group_logging(os_id): False [ 713.015321] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.015689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.015881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.016207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.016550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.017897] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.017897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.017897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.017897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.017897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.017897] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be created. [ 713.076828] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.076828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.076828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.076828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.077065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.086153] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.086376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.086487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.086657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.086749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.086955] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a already deleted. [ 713.087064] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.087267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.087502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.087681] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.092719] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 713.618768] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.618768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.618768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.618768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.618768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.618768] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a already deleted. [ 713.619225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.644329] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: SUCCESS [ 714.644329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.966549] env[69647]: INFO networking_nsxv3.common.synchronization [None req-92bb24cb-acd0-446e-ae4f-22d72dd08f03 None None] Enqueued Resource ID: 8fbe7972-f173-4a47-b168-691bda3db129 with Priority: HIGHEST for action port [ 714.967259] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fbe7972-f173-4a47-b168-691bda3db129 with Priority: HIGHEST for action port [ 714.967582] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fbe7972-f173-4a47-b168-691bda3db129 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.967703] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fbe7972-f173-4a47-b168-691bda3db129" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.967768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fbe7972-f173-4a47-b168-691bda3db129" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.968052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fbe7972-f173-4a47-b168-691bda3db129" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.968134] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fbe7972-f173-4a47-b168-691bda3db129',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.105302] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 715.106798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.473395] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fbe7972-f173-4a47-b168-691bda3db129 [ 715.473628] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.473776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.473845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.474090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.474185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.474281] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fbe7972-f173-4a47-b168-691bda3db129 already deleted. [ 715.474380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fbe7972-f173-4a47-b168-691bda3db129" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.976457] env[69647]: INFO networking_nsxv3.common.synchronization [req-6b80517f-010e-48c6-b37d-591f69ad7447 req-388a2bc3-1c7c-42f5-b3e0-2dab62b45ce5 tempest-ServersNegativeTestMultiTenantJSON-590817475 tempest-ServersNegativeTestMultiTenantJSON-590817475-project-member] Enqueued Resource ID: 6021692f-e8df-461c-b23d-d43cfa61c675 with Priority: HIGHEST for action security_group_members [ 715.976457] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021692f-e8df-461c-b23d-d43cfa61c675 with Priority: HIGHEST for action security_group_members [ 715.976457] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021692f-e8df-461c-b23d-d43cfa61c675 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.976457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.976457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.976457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.976457] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.976457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.976457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.976457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.976457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.976457] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021692f-e8df-461c-b23d-d43cfa61c675',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.272430] env[69647]: INFO networking_nsxv3.common.synchronization [None req-30193a63-a0dc-4b91-a63d-e2172f681ed0 None None] Enqueued Resource ID: 4aa38d4d-7552-4130-8d74-be5661292b47 with Priority: HIGHEST for action port [ 716.272848] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa38d4d-7552-4130-8d74-be5661292b47 with Priority: HIGHEST for action port [ 716.273258] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-4aa38d4d-7552-4130-8d74-be5661292b47 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.273403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4aa38d4d-7552-4130-8d74-be5661292b47" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.273472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4aa38d4d-7552-4130-8d74-be5661292b47" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.273750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4aa38d4d-7552-4130-8d74-be5661292b47" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.273841] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aa38d4d-7552-4130-8d74-be5661292b47',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.409158] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.409158] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-581" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.409158] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-581" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.409158] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-581" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.412786] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.412786] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.412786] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.412786] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.412786] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.412786] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.412786] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.412786] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.412786] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.412786] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.412786] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.412786] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.435677] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.435677] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 716.435677] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.435677] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-581" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.435677] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.435677] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.435677] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.435677] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.435677] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.479504] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.479748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.479748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.480101] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.480101] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.480774] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.481020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.481119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.481348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.481408] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.481487] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021692f-e8df-461c-b23d-d43cfa61c675 already deleted. [ 716.481716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.596240] env[69647]: INFO networking_nsxv3.common.synchronization [None req-2544b173-44ba-405d-9bb0-bf81d932d6d8 None None] Enqueued Resource ID: 37608f3a-ee41-478b-965e-90b7ccf046e2 with Priority: HIGHEST for action port [ 716.596943] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37608f3a-ee41-478b-965e-90b7ccf046e2 with Priority: HIGHEST for action port [ 716.597301] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-37608f3a-ee41-478b-965e-90b7ccf046e2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.597453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37608f3a-ee41-478b-965e-90b7ccf046e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.597543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37608f3a-ee41-478b-965e-90b7ccf046e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.597909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37608f3a-ee41-478b-965e-90b7ccf046e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.597909] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37608f3a-ee41-478b-965e-90b7ccf046e2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.776519] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4aa38d4d-7552-4130-8d74-be5661292b47 [ 716.776756] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.776891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.776958] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.777199] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.777287] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.777378] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4aa38d4d-7552-4130-8d74-be5661292b47 already deleted. [ 716.777454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4aa38d4d-7552-4130-8d74-be5661292b47" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.939700] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.939700] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.939889] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.940973] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.940973] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.940973] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3 not found, creating... [ 716.940973] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.940973] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.941216] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.941379] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.949482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.949482] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.949482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.949482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.949482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.949482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.949482] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3 is going to be created. [ 717.051767] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.052156] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.052156] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.055070] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.055386] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.055680] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.101435] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37608f3a-ee41-478b-965e-90b7ccf046e2 [ 717.101435] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.103275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.103354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.103570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.103670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.103767] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37608f3a-ee41-478b-965e-90b7ccf046e2 already deleted. [ 717.104113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37608f3a-ee41-478b-965e-90b7ccf046e2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.801196] env[69647]: INFO networking_nsxv3.common.synchronization [req-6b80517f-010e-48c6-b37d-591f69ad7447 req-20a7ac7d-8d88-4285-9d40-dba0a2240ea2 service nova] Enqueued Resource ID: 6021692f-e8df-461c-b23d-d43cfa61c675 with Priority: HIGHEST for action security_group_rules [ 717.801521] env[69647]: INFO networking_nsxv3.common.synchronization [req-6b80517f-010e-48c6-b37d-591f69ad7447 req-20a7ac7d-8d88-4285-9d40-dba0a2240ea2 service nova] Enqueued Resource ID: 6021692f-e8df-461c-b23d-d43cfa61c675 with Priority: HIGHEST for action security_group_members [ 717.801521] env[69647]: INFO networking_nsxv3.common.synchronization [req-6b80517f-010e-48c6-b37d-591f69ad7447 req-20a7ac7d-8d88-4285-9d40-dba0a2240ea2 service nova] Enqueued Resource ID: 920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3 with Priority: HIGHEST for action port [ 717.802154] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021692f-e8df-461c-b23d-d43cfa61c675 with Priority: HIGHEST for action security_group_rules [ 717.802343] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021692f-e8df-461c-b23d-d43cfa61c675 with Priority: HIGHEST for action security_group_members [ 717.802566] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3 with Priority: HIGHEST for action port [ 717.802928] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6021692f-e8df-461c-b23d-d43cfa61c675 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.803085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.803171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.803547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.803659] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6021692f-e8df-461c-b23d-d43cfa61c675',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.804587] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021692f-e8df-461c-b23d-d43cfa61c675 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.804696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.804766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.804946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.805121] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.805240] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.805302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.805539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.805594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.805594] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021692f-e8df-461c-b23d-d43cfa61c675',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.806505] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.806662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.806697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.806915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.806915] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.309723] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021692f-e8df-461c-b23d-d43cfa61c675 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.310063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.310115] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6021692f-e8df-461c-b23d-d43cfa61c675',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.313879] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3 with status ACTIVE [ 718.314196] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.314809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.314955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.315233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.316631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.316896] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.317186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.317307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.317536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.317682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.317931] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.318104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.318213] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.318442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.318566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.318693] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3 is going to be updated. [ 718.337916] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.338376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.338376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.338768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.338981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.339227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-920f1e1d-69a6-4cd1-bbba-2181fa5fa8b3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.553500] env[69647]: INFO networking_nsxv3.common.synchronization [None req-1208546f-7337-47dd-8f96-c40af634b491 None None] Enqueued Resource ID: a77e2a98-65d4-41c9-9476-370e53fc3159 with Priority: HIGHEST for action port [ 718.556940] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a77e2a98-65d4-41c9-9476-370e53fc3159 with Priority: HIGHEST for action port [ 718.557517] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a77e2a98-65d4-41c9-9476-370e53fc3159 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.557619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a77e2a98-65d4-41c9-9476-370e53fc3159" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.557619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a77e2a98-65d4-41c9-9476-370e53fc3159" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.557988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a77e2a98-65d4-41c9-9476-370e53fc3159" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.557988] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a77e2a98-65d4-41c9-9476-370e53fc3159',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.773379] env[69647]: INFO networking_nsxv3.common.synchronization [None req-0ca6f855-219e-45a5-89ce-f1d4969b08cc tempest-AttachVolumeShelveTestJSON-989009573 tempest-AttachVolumeShelveTestJSON-989009573-project-member] Enqueued Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_rules [ 718.773379] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_rules [ 718.773749] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.773807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.773871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.774829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.775029] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.816408] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6021692f-e8df-461c-b23d-d43cfa61c675',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.833558] env[69647]: INFO networking_nsxv3.common.synchronization [None req-98590d32-5c30-4df4-8426-e1498a1fe387 None None] Enqueued Resource ID: 41fa6c1d-0c70-44ba-af41-028601d0dbbc with Priority: HIGHEST for action port [ 718.834098] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41fa6c1d-0c70-44ba-af41-028601d0dbbc with Priority: HIGHEST for action port [ 718.834530] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-41fa6c1d-0c70-44ba-af41-028601d0dbbc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.834613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41fa6c1d-0c70-44ba-af41-028601d0dbbc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.834645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41fa6c1d-0c70-44ba-af41-028601d0dbbc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.834898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41fa6c1d-0c70-44ba-af41-028601d0dbbc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.834976] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41fa6c1d-0c70-44ba-af41-028601d0dbbc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.969743] env[69647]: INFO networking_nsxv3.common.synchronization [None req-96f42900-1c75-4f01-878f-b483d83ffa02 tempest-AttachVolumeShelveTestJSON-989009573 tempest-AttachVolumeShelveTestJSON-989009573-project-member] Enqueued Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_rules [ 718.972348] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_rules [ 718.972778] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.972870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.067693] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a77e2a98-65d4-41c9-9476-370e53fc3159 [ 719.067941] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.068098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.068166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.068389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.068477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.068570] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a77e2a98-65d4-41c9-9476-370e53fc3159 already deleted. [ 719.068649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a77e2a98-65d4-41c9-9476-370e53fc3159" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.300948] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.301124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.301124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.301683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.301683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.301683] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 already deleted. [ 719.301683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.302228] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.302228] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.302228] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.320157] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.320157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.320157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.320157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.320157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.320778] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021692f-e8df-461c-b23d-d43cfa61c675 is going to be created. [ 719.338900] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41fa6c1d-0c70-44ba-af41-028601d0dbbc [ 719.339207] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.339350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.339419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.339651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.339760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.339858] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41fa6c1d-0c70-44ba-af41-028601d0dbbc already deleted. [ 719.339938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41fa6c1d-0c70-44ba-af41-028601d0dbbc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.342852] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.342917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.342992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.343211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.343358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.348237] env[69647]: INFO networking_nsxv3.common.synchronization [req-38767768-2f33-4b5f-aab2-919b899cf53a req-6e25d898-7b52-4a47-b652-8e3d6f5e907d tempest-DeleteServersAdminTestJSON-1541525431 tempest-DeleteServersAdminTestJSON-1541525431-project-member] Enqueued Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 719.349462] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 719.349462] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.351320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.351320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.351320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.351320] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.351320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.351320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.351320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.351320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.351320] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.352198] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021692f-e8df-461c-b23d-d43cfa61c675 in Status: UNINITIALIZED for 2s [ 719.828628] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.828628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.828628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.828628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.828628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.828628] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 already deleted. [ 719.829369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.846079] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.846079] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.846079] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.846436] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.846621] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.846725] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.846837] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.848067] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.848067] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.849012] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.849012] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.849012] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.849012] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.849012] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.849012] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.849012] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.855655] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.855655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.855655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.855655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.855655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.855655] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.855655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.855655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.855655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.855655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.856376] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 is going to be updated. [ 719.875327] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.876885] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 719.876885] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.876885] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.876885] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-a5b6acaf-4dcf-47f6-a848-614a9166f30d taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.876885] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-a5b6acaf-4dcf-47f6-a848-614a9166f30d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.876885] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-a5b6acaf-4dcf-47f6-a848-614a9166f30d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.876885] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-a5b6acaf-4dcf-47f6-a848-614a9166f30d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.877264] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5b6acaf-4dcf-47f6-a848-614a9166f30d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.883520] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.883670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.884057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.884057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.886341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.892339] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: IN_PROGRESS for 2s [ 720.383614] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.384042] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.384042] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.384278] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.384427] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.384579] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port a5b6acaf-4dcf-47f6-a848-614a9166f30d not found, creating... [ 720.384832] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.384988] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.385185] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.385423] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.385565] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.386053] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.386237] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.386482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.386776] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.386938] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.387102] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: a5b6acaf-4dcf-47f6-a848-614a9166f30d is going to be created. [ 720.406102] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.406324] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.406446] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.406718] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.406941] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.407177] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-a5b6acaf-4dcf-47f6-a848-614a9166f30d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.313045] env[69647]: INFO networking_nsxv3.common.synchronization [req-38767768-2f33-4b5f-aab2-919b899cf53a req-8cd4064d-4c70-43f3-b6b9-8194760f4644 service nova] Enqueued Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_rules [ 721.313369] env[69647]: INFO networking_nsxv3.common.synchronization [req-38767768-2f33-4b5f-aab2-919b899cf53a req-8cd4064d-4c70-43f3-b6b9-8194760f4644 service nova] Enqueued Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 721.313590] env[69647]: INFO networking_nsxv3.common.synchronization [req-38767768-2f33-4b5f-aab2-919b899cf53a req-8cd4064d-4c70-43f3-b6b9-8194760f4644 service nova] Enqueued Resource ID: a5b6acaf-4dcf-47f6-a848-614a9166f30d with Priority: HIGHEST for action port [ 721.314209] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_rules [ 721.314384] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 721.314524] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5b6acaf-4dcf-47f6-a848-614a9166f30d with Priority: HIGHEST for action port [ 721.315230] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.315230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.315230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.315230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.315423] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.316502] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.316598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.316793] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5b6acaf-4dcf-47f6-a848-614a9166f30d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.316895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5b6acaf-4dcf-47f6-a848-614a9166f30d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.316958] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5b6acaf-4dcf-47f6-a848-614a9166f30d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.317147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5b6acaf-4dcf-47f6-a848-614a9166f30d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.317226] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5b6acaf-4dcf-47f6-a848-614a9166f30d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.361659] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021692f-e8df-461c-b23d-d43cfa61c675 in Status: SUCCESS [ 721.361999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.362134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.362357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.362574] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.362692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.362764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.362924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.363024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.363114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.363207] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6021692f-e8df-461c-b23d-d43cfa61c675',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.818769] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.819072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.819186] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5b6acaf-4dcf-47f6-a848-614a9166f30d with status ACTIVE [ 721.819412] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.819490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.819558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.819784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.819897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.820090] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.820278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.820278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.820461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.823676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.823676] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.823676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.823676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.823676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.823676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.823676] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5b6acaf-4dcf-47f6-a848-614a9166f30d is going to be updated. [ 721.845253] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.845678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.845678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.845783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.845913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.846280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5b6acaf-4dcf-47f6-a848-614a9166f30d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.869093] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021692f-e8df-461c-b23d-d43cfa61c675 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.869093] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.869093] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021692f-e8df-461c-b23d-d43cfa61c675 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.869093] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.869093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.869781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.869781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.869781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.869781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.869781] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6021692f-e8df-461c-b23d-d43cfa61c675',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.915424] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: SUCCESS [ 721.915506] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 deletion is rescheduled due to dependency. [ 721.915621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.916343] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.916560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.916753] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.916865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.916925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.917097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.917172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.917267] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.150108] env[69647]: INFO networking_nsxv3.common.synchronization [req-983ed2c6-ade9-4f1d-8b5c-adae7df3187c req-80495b37-3034-4575-9aa0-caa8ac736313 tempest-AttachInterfacesV270Test-1863027340 tempest-AttachInterfacesV270Test-1863027340-project-member] Enqueued Resource ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 with Priority: HIGHEST for action security_group_members [ 722.150671] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 with Priority: HIGHEST for action security_group_members [ 722.154721] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-90e6d13e-7877-4688-9ade-504a1a3d2a71 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.154721] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.154891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.155835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.155835] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.156832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.156832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.156832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.156832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.156832] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90e6d13e-7877-4688-9ade-504a1a3d2a71',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.373392] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6021692f-e8df-461c-b23d-d43cfa61c675: rpc.has_security_group_logging(os_id): False [ 722.394118] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.394118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.394118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.394118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.394118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.394118] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.394118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.394118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.394118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.394118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.394118] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.394837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.395029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.395419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.395706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.396025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.396298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.396457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.396684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.396919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.397105] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6021692f-e8df-461c-b23d-d43cfa61c675 is going to be created. [ 722.421471] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.452604] env[69647]: INFO networking_nsxv3.common.synchronization [None req-a81986f5-c81d-408b-bba4-84d9d93fa2b8 None None] Enqueued Resource ID: 1e914fc9-87fd-4784-98c7-8de56bb2b063 with Priority: HIGHEST for action port [ 722.454038] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e914fc9-87fd-4784-98c7-8de56bb2b063 with Priority: HIGHEST for action port [ 722.455862] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.457589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.457589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.457712] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.457859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.459799] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e914fc9-87fd-4784-98c7-8de56bb2b063 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.459919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e914fc9-87fd-4784-98c7-8de56bb2b063" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.460384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e914fc9-87fd-4784-98c7-8de56bb2b063" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.460524] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e914fc9-87fd-4784-98c7-8de56bb2b063" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.460621] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e914fc9-87fd-4784-98c7-8de56bb2b063',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.473340] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021692f-e8df-461c-b23d-d43cfa61c675 in Status: IN_PROGRESS for 2s [ 722.659547] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.659547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.659837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.659837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.659929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.660256] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.660361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.660361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.660552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.660649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.660723] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 is going to be updated. [ 722.691215] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.691430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.691430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.691673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.691764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.701382] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 in Status: IN_PROGRESS for 2s [ 722.926595] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.963179] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e914fc9-87fd-4784-98c7-8de56bb2b063 [ 722.963445] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.963591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.963891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.964164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.964272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.964379] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e914fc9-87fd-4784-98c7-8de56bb2b063 already deleted. [ 722.964463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e914fc9-87fd-4784-98c7-8de56bb2b063" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.434639] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.434775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.434857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.435063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.435158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.435257] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 is going to be updated. [ 723.464172] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.464384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.464464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.464676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.464922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.473901] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: IN_PROGRESS for 2s [ 723.952712] env[69647]: INFO networking_nsxv3.common.synchronization [None req-8d2f9071-937c-49d3-a7f0-10be92e495e4 tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_rules [ 723.953402] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_rules [ 723.953653] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.953777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.954030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.954583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.954583] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.039746] env[69647]: INFO networking_nsxv3.common.synchronization [None req-c8eade1c-f757-4131-b8c2-b21ff6edfb9a tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_rules [ 724.039746] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_rules [ 724.040126] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.040235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.486818] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6021692f-e8df-461c-b23d-d43cfa61c675 in Status: SUCCESS [ 724.487397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.491834] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.491834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.491834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.491834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.491834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.491834] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 already deleted. [ 724.491834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.491834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.492323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.492571] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.549142] env[69647]: INFO networking_nsxv3.common.synchronization [None req-27c4a66c-57db-4f1e-9af9-7f34896a3f8c None None] Enqueued Resource ID: d1b0e1d1-8c35-4b52-b473-f40650a734b2 with Priority: HIGHEST for action port [ 724.549342] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1b0e1d1-8c35-4b52-b473-f40650a734b2 with Priority: HIGHEST for action port [ 724.549559] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1b0e1d1-8c35-4b52-b473-f40650a734b2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.554844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1b0e1d1-8c35-4b52-b473-f40650a734b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.555077] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1b0e1d1-8c35-4b52-b473-f40650a734b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.555432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1b0e1d1-8c35-4b52-b473-f40650a734b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.555549] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1b0e1d1-8c35-4b52-b473-f40650a734b2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.712272] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 in Status: SUCCESS [ 724.712561] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 deletion is rescheduled due to dependency. [ 724.712756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.029286] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.029581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.029581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.029739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.029830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.029936] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 already deleted. [ 725.030027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.060034] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1b0e1d1-8c35-4b52-b473-f40650a734b2 [ 725.060034] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.060034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.060034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.060388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.060388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.060443] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1b0e1d1-8c35-4b52-b473-f40650a734b2 already deleted. [ 725.060517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1b0e1d1-8c35-4b52-b473-f40650a734b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.484727] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: SUCCESS [ 725.485039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.485237] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.485513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.485759] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.485939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.485974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.486147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.486254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.486347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.486444] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.611636] env[69647]: INFO networking_nsxv3.common.synchronization [req-a5410f08-6a33-4175-bf76-d43e9ec76074 req-81c4d9f4-afc0-4034-b01d-29e77db8e135 tempest-ImagesTestJSON-954996409 tempest-ImagesTestJSON-954996409-project-member] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 725.612289] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 725.612643] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.612794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.612884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.613717] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.616079] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.616263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.616304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.616492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.616654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.616770] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.988787] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.990793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.990793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.990793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.991186] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.991186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.991186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.991321] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.991351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.993021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.993021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.993021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.993021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.993021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.993021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.993021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.993021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.993021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.993021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.993021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.993021] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.031211] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-984 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.031211] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.031211] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.031211] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.031703] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.031703] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.031914] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.033080] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.033080] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.033080] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.033080] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.033080] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.033080] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.033080] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.033080] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.033379] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.052160] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.052370] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 726.052540] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.052685] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.053084] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-6c6b4d17-5b9b-48de-ae77-26171c0f0713 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.053322] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-6c6b4d17-5b9b-48de-ae77-26171c0f0713" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.053322] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-6c6b4d17-5b9b-48de-ae77-26171c0f0713" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.053654] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-6c6b4d17-5b9b-48de-ae77-26171c0f0713" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.053793] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c6b4d17-5b9b-48de-ae77-26171c0f0713',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.121186] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.123551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.123551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.123551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.123551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.123551] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.123551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.123551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.123551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.123551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.123551] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 already deleted. [ 726.123551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.498222] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37805a80-67ab-4e0f-8bc6-d25e71e20586: rpc.has_security_group_logging(os_id): False [ 726.516180] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.516598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.516598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.516800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.516800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.516943] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.517030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.517078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.517218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.517296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.517472] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.517572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.517619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.517901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.517901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.517997] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.518121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.518187] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.518332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.518406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.519031] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 is going to be updated. [ 726.556415] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.556665] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.560033] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.560373] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.560596] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.560818] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 6c6b4d17-5b9b-48de-ae77-26171c0f0713 not found, creating... [ 726.561208] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.561377] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.561492] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.561736] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.561887] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.562996] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.562996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.562996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.562996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.562996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.562996] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 6c6b4d17-5b9b-48de-ae77-26171c0f0713 is going to be created. [ 726.587269] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.587524] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.587657] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.587975] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.588297] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.588564] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-6c6b4d17-5b9b-48de-ae77-26171c0f0713" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.590380] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.590536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.590605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.590832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.591023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.611280] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: IN_PROGRESS for 2s [ 727.424558] env[69647]: INFO networking_nsxv3.common.synchronization [req-a5410f08-6a33-4175-bf76-d43e9ec76074 req-273bda18-3f8d-4294-b831-9f87fefffed3 service nova] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_rules [ 727.425415] env[69647]: INFO networking_nsxv3.common.synchronization [req-a5410f08-6a33-4175-bf76-d43e9ec76074 req-273bda18-3f8d-4294-b831-9f87fefffed3 service nova] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 727.425855] env[69647]: INFO networking_nsxv3.common.synchronization [req-a5410f08-6a33-4175-bf76-d43e9ec76074 req-273bda18-3f8d-4294-b831-9f87fefffed3 service nova] Enqueued Resource ID: 6c6b4d17-5b9b-48de-ae77-26171c0f0713 with Priority: HIGHEST for action port [ 727.426474] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_rules [ 727.426716] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 727.427539] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c6b4d17-5b9b-48de-ae77-26171c0f0713 with Priority: HIGHEST for action port [ 727.428228] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.428458] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.428625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.431500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.431500] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.431500] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.431500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.431500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.431500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.431500] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.431500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.431500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.431500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.431500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.431500] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.434889] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c6b4d17-5b9b-48de-ae77-26171c0f0713 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.435150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c6b4d17-5b9b-48de-ae77-26171c0f0713" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.435295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c6b4d17-5b9b-48de-ae77-26171c0f0713" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.435572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c6b4d17-5b9b-48de-ae77-26171c0f0713" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.435774] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c6b4d17-5b9b-48de-ae77-26171c0f0713',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.935755] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.937379] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.937487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.939425] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c6b4d17-5b9b-48de-ae77-26171c0f0713 with status ACTIVE [ 727.939617] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.939746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.939817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.940052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.940159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.940333] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.940438] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.940501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.940666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.940746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.940925] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.941099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.941165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.941309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.941383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.941470] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c6b4d17-5b9b-48de-ae77-26171c0f0713 is going to be updated. [ 727.961609] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.961609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.961609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.961609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.961609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.961609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c6b4d17-5b9b-48de-ae77-26171c0f0713" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.373591] env[69647]: INFO networking_nsxv3.common.synchronization [req-839317c7-dce4-4b29-b456-9ca65b1fe390 req-a7109631-373a-4090-89a8-f309a7c97ec0 tempest-ServersTestManualDisk-61462443 tempest-ServersTestManualDisk-61462443-project-member] Enqueued Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_members [ 728.373591] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_members [ 728.373591] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-627fe875-c21d-4d02-9ec5-0f012cb64fc1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.373591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.374806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.375225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.375489] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.375745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.375922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.376185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.376383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.376581] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('627fe875-c21d-4d02-9ec5-0f012cb64fc1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.440282] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.625329] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: SUCCESS [ 728.625579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.685316] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-683 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.685552] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-683" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.685679] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-683" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.686026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-683" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.686298] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.686469] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.686574] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.686803] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.686942] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.687617] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.687802] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.687993] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.688194] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.688329] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 728.688496] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.688675] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.707623] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.707623] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 728.707623] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.707623] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-683" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.708160] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-47c7cf2d-1232-4279-914c-eb1178ebb516 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.709131] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-47c7cf2d-1232-4279-914c-eb1178ebb516" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.709793] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-47c7cf2d-1232-4279-914c-eb1178ebb516" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.710199] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-47c7cf2d-1232-4279-914c-eb1178ebb516" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.710735] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47c7cf2d-1232-4279-914c-eb1178ebb516',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.879042] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.879353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.879446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.879643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.879724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.879938] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.880035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.880097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.880248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.880319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.880413] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 already deleted. [ 728.880491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.947123] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.947290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.947361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.947657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.947709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.947815] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be created. [ 728.969491] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.969680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.969885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.970025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.970212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.980021] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: UNINITIALIZED for 2s [ 729.213731] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.213965] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.214117] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.214418] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.214562] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.214718] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 47c7cf2d-1232-4279-914c-eb1178ebb516 not found, creating... [ 729.214983] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.215153] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.215271] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.215497] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.215632] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.215935] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.216102] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.216193] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.216402] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.216535] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.216674] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 47c7cf2d-1232-4279-914c-eb1178ebb516 is going to be created. [ 729.240584] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.240812] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.241142] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.241473] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.241703] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.241936] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-47c7cf2d-1232-4279-914c-eb1178ebb516" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.404152] env[69647]: INFO networking_nsxv3.common.synchronization [req-22e95913-4451-4452-bf31-6fbe2f4ad9cf req-d83147bb-7eb7-442f-899f-3565b16bb50c tempest-ImagesOneServerTestJSON-207396395 tempest-ImagesOneServerTestJSON-207396395-project-member] Enqueued Resource ID: dea7752c-71a7-48c6-ad69-e6c96549e90c with Priority: HIGHEST for action security_group_members [ 729.404800] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea7752c-71a7-48c6-ad69-e6c96549e90c with Priority: HIGHEST for action security_group_members [ 729.407174] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dea7752c-71a7-48c6-ad69-e6c96549e90c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.407174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.407174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.407464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.407628] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.407753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.407830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.408037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.408122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.408335] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dea7752c-71a7-48c6-ad69-e6c96549e90c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.911814] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.912128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.912165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.912386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.912476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.912672] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.912774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.912832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.912977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.913061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.913146] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea7752c-71a7-48c6-ad69-e6c96549e90c is going to be updated. [ 729.939379] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.939575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.939891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.940390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.941016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.947869] env[69647]: INFO networking_nsxv3.common.synchronization [req-839317c7-dce4-4b29-b456-9ca65b1fe390 req-fc0d505c-11b1-4a65-91b7-cb1673987f19 service nova] Enqueued Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_rules [ 729.948209] env[69647]: INFO networking_nsxv3.common.synchronization [req-839317c7-dce4-4b29-b456-9ca65b1fe390 req-fc0d505c-11b1-4a65-91b7-cb1673987f19 service nova] Enqueued Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_members [ 729.948433] env[69647]: INFO networking_nsxv3.common.synchronization [req-839317c7-dce4-4b29-b456-9ca65b1fe390 req-fc0d505c-11b1-4a65-91b7-cb1673987f19 service nova] Enqueued Resource ID: 47c7cf2d-1232-4279-914c-eb1178ebb516 with Priority: HIGHEST for action port [ 729.949590] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_rules [ 729.950423] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_members [ 729.950566] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47c7cf2d-1232-4279-914c-eb1178ebb516 with Priority: HIGHEST for action port [ 729.954650] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.954650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.954650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.954650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.954650] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627fe875-c21d-4d02-9ec5-0f012cb64fc1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.954650] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-627fe875-c21d-4d02-9ec5-0f012cb64fc1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.955130] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.955130] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.955130] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.955446] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.955446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.955573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.955818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.956305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.956393] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('627fe875-c21d-4d02-9ec5-0f012cb64fc1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.958071] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-47c7cf2d-1232-4279-914c-eb1178ebb516 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.958428] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47c7cf2d-1232-4279-914c-eb1178ebb516" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.958552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47c7cf2d-1232-4279-914c-eb1178ebb516" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.958766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47c7cf2d-1232-4279-914c-eb1178ebb516" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.959694] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47c7cf2d-1232-4279-914c-eb1178ebb516',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.962300] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea7752c-71a7-48c6-ad69-e6c96549e90c in Status: IN_PROGRESS for 2s [ 730.454914] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-627fe875-c21d-4d02-9ec5-0f012cb64fc1 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.455131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.464448] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('627fe875-c21d-4d02-9ec5-0f012cb64fc1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.465452] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47c7cf2d-1232-4279-914c-eb1178ebb516 with status ACTIVE [ 730.465654] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.469104] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.469104] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.469104] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47c7cf2d-1232-4279-914c-eb1178ebb516 is going to be updated. [ 730.488311] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.488449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.488512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.488723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.488849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.489013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47c7cf2d-1232-4279-914c-eb1178ebb516" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.935891] env[69647]: INFO networking_nsxv3.common.synchronization [None req-7726d339-8317-4974-b0f8-7b10523729c5 None None] Enqueued Resource ID: 4d4afdc6-8443-4fac-a543-8cf242126a9d with Priority: HIGHEST for action port [ 730.936195] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d4afdc6-8443-4fac-a543-8cf242126a9d with Priority: HIGHEST for action port [ 730.936750] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d4afdc6-8443-4fac-a543-8cf242126a9d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.936876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d4afdc6-8443-4fac-a543-8cf242126a9d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.936943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d4afdc6-8443-4fac-a543-8cf242126a9d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.937207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d4afdc6-8443-4fac-a543-8cf242126a9d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.937292] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d4afdc6-8443-4fac-a543-8cf242126a9d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.970054] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('627fe875-c21d-4d02-9ec5-0f012cb64fc1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.990304] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 730.990520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.990941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.991186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.991376] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.991491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.991557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.991707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.991789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.991874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.991959] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.277395] env[69647]: INFO networking_nsxv3.common.synchronization [req-ff55c407-143c-4735-bc57-c1e049acfba8 req-8930489b-a695-4f44-b2ae-9414faec0e6d tempest-ServersNegativeTestMultiTenantJSON-590817475 tempest-ServersNegativeTestMultiTenantJSON-590817475-project-member] Enqueued Resource ID: 6021692f-e8df-461c-b23d-d43cfa61c675 with Priority: HIGHEST for action security_group_members [ 731.279970] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021692f-e8df-461c-b23d-d43cfa61c675 with Priority: HIGHEST for action security_group_members [ 731.280391] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6021692f-e8df-461c-b23d-d43cfa61c675 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.280557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.280629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.280869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.281061] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.281162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.281215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.281640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.281640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.281640] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6021692f-e8df-461c-b23d-d43cfa61c675',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.410279] env[69647]: INFO networking_nsxv3.common.synchronization [None req-4f549eb6-1650-460f-a429-eb5591035060 None None] Enqueued Resource ID: 9186915a-ff11-4a9f-8ace-d2e9b04774f1 with Priority: HIGHEST for action port [ 731.410553] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9186915a-ff11-4a9f-8ace-d2e9b04774f1 with Priority: HIGHEST for action port [ 731.411158] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-9186915a-ff11-4a9f-8ace-d2e9b04774f1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.411278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9186915a-ff11-4a9f-8ace-d2e9b04774f1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.411341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9186915a-ff11-4a9f-8ace-d2e9b04774f1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.411590] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9186915a-ff11-4a9f-8ace-d2e9b04774f1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.411667] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9186915a-ff11-4a9f-8ace-d2e9b04774f1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.441017] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d4afdc6-8443-4fac-a543-8cf242126a9d [ 731.441017] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.441017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.441247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.441583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.441583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.441657] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d4afdc6-8443-4fac-a543-8cf242126a9d already deleted. [ 731.441686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d4afdc6-8443-4fac-a543-8cf242126a9d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.479371] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.479371] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.479371] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.479371] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.479371] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.479371] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 is going to be created. [ 731.497660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.497660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.497660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.497660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.497660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.497660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.497660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.497660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.497660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.497660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.497660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.497660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.497660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.497660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.498124] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.498124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.498124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.498124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.498124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.498452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.498542] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.500271] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.500385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.500455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.500753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.500753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.511266] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 in Status: UNINITIALIZED for 2s [ 731.786334] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.787890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.787890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.787890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.787890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.787890] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.787890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.787890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.787890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.787890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.787890] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021692f-e8df-461c-b23d-d43cfa61c675 is going to be updated. [ 731.814334] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.817861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.817861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.817861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.817861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.824760] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021692f-e8df-461c-b23d-d43cfa61c675 in Status: IN_PROGRESS for 2s [ 731.985300] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9186915a-ff11-4a9f-8ace-d2e9b04774f1 [ 731.985572] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.985710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.985710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.985908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.985954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.986079] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9186915a-ff11-4a9f-8ace-d2e9b04774f1 already deleted. [ 731.986162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9186915a-ff11-4a9f-8ace-d2e9b04774f1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.988609] env[69647]: INFO networking_nsxv3.common.synchronization [req-ef3a3a29-667e-4776-ab08-e3bd7d6ea214 req-90316d3d-b936-4518-a44c-a451b7155da4 tempest-MigrationsAdminTest-1337534586 tempest-MigrationsAdminTest-1337534586-project-member] Enqueued Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 731.988609] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 731.989421] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.989547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.989547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.991053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.991053] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.991053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.991053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.991053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.991053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.991053] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.995801] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dea7752c-71a7-48c6-ad69-e6c96549e90c in Status: SUCCESS [ 731.995971] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dea7752c-71a7-48c6-ad69-e6c96549e90c deletion is rescheduled due to dependency. [ 731.996088] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.003373] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac810154-f096-4495-a2c8-d43e5bb3d1a2: rpc.has_security_group_logging(os_id): False [ 732.020143] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.020366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.020938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.020938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.020938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.021682] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.021682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.021682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.021682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.021960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.021960] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.022107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.022149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.022333] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.022405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.022597] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.022683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.022741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.022949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.022949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.023069] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be created. [ 732.091040] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.091040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.091040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.091040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.091040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.109633] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 732.492801] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.492914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.493044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.493381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.493801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.493894] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.494013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.494137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.494395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.494491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.494640] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 already deleted. [ 732.494693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.696810] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.698300] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.698300] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.698300] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.698300] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.698300] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.703353] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.703353] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.703353] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.703353] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.703353] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.703353] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.703353] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.703353] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.703353] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.703353] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.722207] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.722207] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.722207] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.722380] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.722694] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-0d99db88-a94b-4737-9cce-ae284c55bd60 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.722906] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-0d99db88-a94b-4737-9cce-ae284c55bd60" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.722971] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-0d99db88-a94b-4737-9cce-ae284c55bd60" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.723318] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-0d99db88-a94b-4737-9cce-ae284c55bd60" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.723462] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d99db88-a94b-4737-9cce-ae284c55bd60',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.225862] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.226159] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.226323] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.227388] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.227600] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.227885] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 0d99db88-a94b-4737-9cce-ae284c55bd60 not found, creating... [ 733.228143] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.228353] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.228511] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.228824] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.229012] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.229447] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.229674] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.229816] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.230075] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.230256] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.230430] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 0d99db88-a94b-4737-9cce-ae284c55bd60 is going to be created. [ 733.251090] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.251341] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.251660] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.251784] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.252094] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.252416] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-0d99db88-a94b-4737-9cce-ae284c55bd60" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.420313] env[69647]: INFO networking_nsxv3.common.synchronization [None req-504451c3-15d5-4798-8a91-67b29a214686 None None] Enqueued Resource ID: 1c7483fd-00a6-4e09-b503-326a4cfdeafb with Priority: HIGHEST for action port [ 733.420585] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c7483fd-00a6-4e09-b503-326a4cfdeafb with Priority: HIGHEST for action port [ 733.424041] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c7483fd-00a6-4e09-b503-326a4cfdeafb taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.424041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c7483fd-00a6-4e09-b503-326a4cfdeafb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.424041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c7483fd-00a6-4e09-b503-326a4cfdeafb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.424041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c7483fd-00a6-4e09-b503-326a4cfdeafb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.424041] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c7483fd-00a6-4e09-b503-326a4cfdeafb',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.461306] env[69647]: INFO networking_nsxv3.common.synchronization [None req-c46ce42b-91b7-44f9-a7b6-f8c871ee8525 tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_rules [ 733.461306] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_rules [ 733.461306] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.461306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.461306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.461306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.461306] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.520725] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 in Status: SUCCESS [ 733.520943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.521425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.521425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.521601] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.521807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.521888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.522054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.522144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.522225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.522316] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('627fe875-c21d-4d02-9ec5-0f012cb64fc1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.585137] env[69647]: INFO networking_nsxv3.common.synchronization [None req-624296d5-c461-420e-ba9e-cc52067c305e tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_rules [ 733.585137] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_rules [ 733.585137] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.585137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.836281] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6021692f-e8df-461c-b23d-d43cfa61c675 in Status: SUCCESS [ 733.836451] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6021692f-e8df-461c-b23d-d43cfa61c675 deletion is rescheduled due to dependency. [ 733.836565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.837398] env[69647]: INFO networking_nsxv3.common.synchronization [None req-13497c96-b655-496f-ab88-d8223eb1e3ef None None] Enqueued Resource ID: f177d3d3-2e5c-42fd-abc9-99a8fb0c9152 with Priority: HIGHEST for action port [ 733.837934] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f177d3d3-2e5c-42fd-abc9-99a8fb0c9152 with Priority: HIGHEST for action port [ 733.838213] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-f177d3d3-2e5c-42fd-abc9-99a8fb0c9152 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.838333] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f177d3d3-2e5c-42fd-abc9-99a8fb0c9152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.838402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f177d3d3-2e5c-42fd-abc9-99a8fb0c9152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.838642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f177d3d3-2e5c-42fd-abc9-99a8fb0c9152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.838724] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f177d3d3-2e5c-42fd-abc9-99a8fb0c9152',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.924091] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c7483fd-00a6-4e09-b503-326a4cfdeafb [ 733.924325] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.924456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.924520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.924724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.924807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.924939] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c7483fd-00a6-4e09-b503-326a4cfdeafb already deleted. [ 733.925067] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c7483fd-00a6-4e09-b503-326a4cfdeafb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.021598] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.021598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.021598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.021598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.021598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.021598] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 already deleted. [ 734.021598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.021598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.021598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.021598] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.024172] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('627fe875-c21d-4d02-9ec5-0f012cb64fc1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.088270] env[69647]: INFO networking_nsxv3.common.synchronization [req-2a40d26b-ca70-4ed5-8b4a-9e2533d85fdb req-8bbe1c3e-1c02-4a9e-8b2d-ecd4f80bacbc tempest-DeleteServersAdminTestJSON-1541525431 tempest-DeleteServersAdminTestJSON-1541525431-project-member] Enqueued Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 734.088270] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGHEST for action security_group_members [ 734.088270] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.088270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.088270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.088270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.088270] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.089470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.089470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.089470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.089559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.089620] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.122251] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 734.122251] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.302674] env[69647]: INFO networking_nsxv3.common.synchronization [req-ef3a3a29-667e-4776-ab08-e3bd7d6ea214 req-20e23a74-5d16-4bc0-99c6-a49799386e4a service nova] Enqueued Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_rules [ 734.302936] env[69647]: INFO networking_nsxv3.common.synchronization [req-ef3a3a29-667e-4776-ab08-e3bd7d6ea214 req-20e23a74-5d16-4bc0-99c6-a49799386e4a service nova] Enqueued Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 734.302982] env[69647]: INFO networking_nsxv3.common.synchronization [req-ef3a3a29-667e-4776-ab08-e3bd7d6ea214 req-20e23a74-5d16-4bc0-99c6-a49799386e4a service nova] Enqueued Resource ID: 0d99db88-a94b-4737-9cce-ae284c55bd60 with Priority: HIGHEST for action port [ 734.303319] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_rules [ 734.303406] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 734.303530] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d99db88-a94b-4737-9cce-ae284c55bd60 with Priority: HIGHEST for action port [ 734.304220] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.304220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.304220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.304423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.304485] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.305929] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.305929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.305929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.305929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.307577] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.307577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.307577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.307577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.307577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.307577] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.307577] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d99db88-a94b-4737-9cce-ae284c55bd60 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.307577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d99db88-a94b-4737-9cce-ae284c55bd60" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.307577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d99db88-a94b-4737-9cce-ae284c55bd60" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.307577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d99db88-a94b-4737-9cce-ae284c55bd60" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.307577] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d99db88-a94b-4737-9cce-ae284c55bd60',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.347183] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f177d3d3-2e5c-42fd-abc9-99a8fb0c9152 [ 734.347398] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.347520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.347589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.347803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.347862] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.347956] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f177d3d3-2e5c-42fd-abc9-99a8fb0c9152 already deleted. [ 734.348200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f177d3d3-2e5c-42fd-abc9-99a8fb0c9152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.527119] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 627fe875-c21d-4d02-9ec5-0f012cb64fc1: rpc.has_security_group_logging(os_id): False [ 734.542026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.542026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.542026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.542026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.542379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.542379] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 already deleted. [ 734.542379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.543773] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.543909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.544072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.544342] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.544509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.544952] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.545553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.545553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.545553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.545553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.545867] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 is going to be created. [ 734.591731] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.591895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.591967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.592249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.592348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.592542] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.592685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.592722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.592856] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.593060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.593060] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 is going to be updated. [ 734.614115] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.614271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.614373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.614576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.614719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.620795] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.620795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.620795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.620948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.620948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.630930] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 in Status: IN_PROGRESS for 2s [ 734.635506] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: IN_PROGRESS for 2s [ 734.809518] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.809632] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.809845] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.810777] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d99db88-a94b-4737-9cce-ae284c55bd60 with status ACTIVE [ 734.810956] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.811058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.811122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.811324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.811412] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.811580] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.811674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.811736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.811880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.811957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.815261] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.815392] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.815459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.815618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.815700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.815788] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d99db88-a94b-4737-9cce-ae284c55bd60 is going to be updated. [ 734.838825] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.838825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.838825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.839110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.839208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.839319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d99db88-a94b-4737-9cce-ae284c55bd60" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.318491] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.750595] env[69647]: INFO networking_nsxv3.common.synchronization [req-d7dac5db-0fc9-46e1-8887-28cd58ae366d req-2fe5bbd5-16e8-4856-b053-4b704d4ad78a tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 735.751524] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 735.751524] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.751810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.751810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.751950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.752259] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.752259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.752368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.752456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.752554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.752655] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.823635] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.823635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.823635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.823635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.823635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.823635] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 is going to be created. [ 735.849701] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.849701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.849701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.849701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.849701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.856536] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: UNINITIALIZED for 2s [ 736.070434] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.070434] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.070434] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.070434] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.070434] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.070829] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.070829] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.070829] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.070990] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.071229] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.071406] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.071526] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.071625] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.071731] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.071839] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.071996] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.089363] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.089363] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 736.089506] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.089672] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.089984] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-36512bd6-5865-4642-874b-66e45c7a2625 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.090176] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-36512bd6-5865-4642-874b-66e45c7a2625" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.090298] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-36512bd6-5865-4642-874b-66e45c7a2625" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.090625] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-36512bd6-5865-4642-874b-66e45c7a2625" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.090766] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36512bd6-5865-4642-874b-66e45c7a2625',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.254322] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.254507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.254594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.254842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.254842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.255042] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.255181] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.255256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.255346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.255425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.255619] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 736.281559] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.281771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.281852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.282017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.282226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.291702] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 736.597207] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.597568] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.597726] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.598078] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.598279] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.598504] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 36512bd6-5865-4642-874b-66e45c7a2625 not found, creating... [ 736.598866] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.599140] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.599301] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.599578] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.602924] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.602924] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.602924] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.602924] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.602924] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.602924] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.602924] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 36512bd6-5865-4642-874b-66e45c7a2625 is going to be created. [ 736.618933] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.619162] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.619293] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.619538] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.619767] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.619990] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-36512bd6-5865-4642-874b-66e45c7a2625" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.641792] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 in Status: SUCCESS [ 736.642050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.642931] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 in Status: SUCCESS [ 736.643108] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 deletion is rescheduled due to dependency. [ 736.643108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.701343] env[69647]: INFO networking_nsxv3.common.synchronization [req-d7dac5db-0fc9-46e1-8887-28cd58ae366d req-71883e90-2512-44ce-aad3-dac80563d5c2 service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 737.701766] env[69647]: INFO networking_nsxv3.common.synchronization [req-d7dac5db-0fc9-46e1-8887-28cd58ae366d req-71883e90-2512-44ce-aad3-dac80563d5c2 service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 737.701885] env[69647]: INFO networking_nsxv3.common.synchronization [req-d7dac5db-0fc9-46e1-8887-28cd58ae366d req-71883e90-2512-44ce-aad3-dac80563d5c2 service nova] Enqueued Resource ID: 36512bd6-5865-4642-874b-66e45c7a2625 with Priority: HIGHEST for action port [ 737.703364] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 737.703965] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 737.703965] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36512bd6-5865-4642-874b-66e45c7a2625 with Priority: HIGHEST for action port [ 737.705030] env[69647]: INFO networking_nsxv3.common.synchronization [req-e5c39ca0-7d7e-4fac-9f12-880753f859b4 req-002bdd88-5800-4683-b652-dc5cb8eb18bc tempest-FloatingIPsAssociationTestJSON-597742564 tempest-FloatingIPsAssociationTestJSON-597742564-project-member] Enqueued Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 737.710168] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.710168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.710168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.710168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.710168] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.710168] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.710168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.710168] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-36512bd6-5865-4642-874b-66e45c7a2625 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.710168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36512bd6-5865-4642-874b-66e45c7a2625" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.710168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36512bd6-5865-4642-874b-66e45c7a2625" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.710168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36512bd6-5865-4642-874b-66e45c7a2625" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.710168] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36512bd6-5865-4642-874b-66e45c7a2625',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.711505] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b with Priority: HIGHEST for action security_group_members [ 737.717381] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-25192273-bc3e-4f3a-9543-1ed380b4ef9b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.717381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.717381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.717558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.717692] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.717752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.717799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.718089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.718089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.718152] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25192273-bc3e-4f3a-9543-1ed380b4ef9b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.866153] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: SUCCESS [ 737.866419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.866876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.866876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.867095] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.867200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.867262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.867422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.867500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.867680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.867743] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.216996] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.217422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.228247] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36512bd6-5865-4642-874b-66e45c7a2625 with status ACTIVE [ 738.228247] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.228247] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.228247] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.228247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.228247] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36512bd6-5865-4642-874b-66e45c7a2625 is going to be updated. [ 738.232018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.232018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.232018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.232018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.232018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.232225] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.232560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.232560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.232560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.232702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.232734] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b is going to be updated. [ 738.254843] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.255026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.255069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.255275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.255412] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.255565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36512bd6-5865-4642-874b-66e45c7a2625" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.261551] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.261750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.261871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.262463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.262463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.269991] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: IN_PROGRESS for 2s [ 738.298772] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 738.298973] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 deletion is rescheduled due to dependency. [ 738.299108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.299359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.299661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.300040] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.300165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.300206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.300396] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.300565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.300674] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.369957] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.370136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.370194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.370409] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.370595] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.370697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.370759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.370913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.370997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.371162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.371313] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.371421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.371484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.371623] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.371758] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.371856] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.371907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.372050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.372168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.372249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.372338] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.808431] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.874640] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c97e0fb-c576-4b45-ad7b-02877e627733: rpc.has_security_group_logging(os_id): False [ 738.892201] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.892536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.892756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.893055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.893262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.893591] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.893783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.893909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.894328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.894485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.894844] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.895118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.895191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.895429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.895588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.895791] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.895897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.896056] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.896345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.896475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.896580] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 is going to be created. [ 738.950991] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.950991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.950991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.952775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.953368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.966035] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: IN_PROGRESS for 2s [ 739.311999] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.815195] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.815673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.815673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.815673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.815850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.815850] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 739.841465] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.841649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.841649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.841797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.841948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.850343] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 740.197612] env[69647]: INFO networking_nsxv3.common.synchronization [req-d0d24e01-23ca-4f0e-9df0-d2d4ce3562fa req-95e29a0b-c5c5-42e7-aa0d-22eacb623451 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_members [ 740.201777] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_members [ 740.201777] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-df955150-4015-4c07-90e5-0a793c5a1b3b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.201777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.201777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.201777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.201777] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.201777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.201777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.201777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.201777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.201777] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df955150-4015-4c07-90e5-0a793c5a1b3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.279176] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b in Status: SUCCESS [ 740.279378] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25192273-bc3e-4f3a-9543-1ed380b4ef9b deletion is rescheduled due to dependency. [ 740.279493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25192273-bc3e-4f3a-9543-1ed380b4ef9b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.705760] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.705929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.706008] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.710372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.710485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.710804] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.710883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.711042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.711137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.711228] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.711319] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df955150-4015-4c07-90e5-0a793c5a1b3b already deleted. [ 740.711401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.722538] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.722741] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.722839] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.723215] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.723479] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.723652] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.723839] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.723989] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.724438] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.727834] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.728042] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.728120] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.728214] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.728323] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.729172] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.729172] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.761274] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.761274] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 740.761274] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.761274] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.761274] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-f2c2db01-c415-49e8-b688-dc482fcaaac6 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.761274] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-f2c2db01-c415-49e8-b688-dc482fcaaac6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.761274] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-f2c2db01-c415-49e8-b688-dc482fcaaac6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.761274] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-f2c2db01-c415-49e8-b688-dc482fcaaac6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.761274] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c2db01-c415-49e8-b688-dc482fcaaac6',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.981023] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: SUCCESS [ 740.981023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.265827] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.266817] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.266817] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.266817] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.266817] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.266817] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port f2c2db01-c415-49e8-b688-dc482fcaaac6 not found, creating... [ 741.267101] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.267240] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.267313] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.267482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.267612] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.267887] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.268042] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.268463] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.268463] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.268567] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.268601] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: f2c2db01-c415-49e8-b688-dc482fcaaac6 is going to be created. [ 741.286683] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.286948] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.287087] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.287364] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.287591] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.287812] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-f2c2db01-c415-49e8-b688-dc482fcaaac6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.860191] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 741.860380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.860546] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.861421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.861636] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.861768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.861837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.862015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.862126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.862217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.862315] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.197791] env[69647]: INFO networking_nsxv3.common.synchronization [req-d0d24e01-23ca-4f0e-9df0-d2d4ce3562fa req-78946a69-f0e9-4c62-9ab7-13c220aa1c01 service nova] Enqueued Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_rules [ 742.198207] env[69647]: INFO networking_nsxv3.common.synchronization [req-d0d24e01-23ca-4f0e-9df0-d2d4ce3562fa req-78946a69-f0e9-4c62-9ab7-13c220aa1c01 service nova] Enqueued Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_members [ 742.198371] env[69647]: INFO networking_nsxv3.common.synchronization [req-d0d24e01-23ca-4f0e-9df0-d2d4ce3562fa req-78946a69-f0e9-4c62-9ab7-13c220aa1c01 service nova] Enqueued Resource ID: f2c2db01-c415-49e8-b688-dc482fcaaac6 with Priority: HIGHEST for action port [ 742.199366] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_rules [ 742.199510] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_members [ 742.199599] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2c2db01-c415-49e8-b688-dc482fcaaac6 with Priority: HIGHEST for action port [ 742.199874] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df955150-4015-4c07-90e5-0a793c5a1b3b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.200445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.200527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.201184] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.201184] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df955150-4015-4c07-90e5-0a793c5a1b3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.201765] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-df955150-4015-4c07-90e5-0a793c5a1b3b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.201957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.202036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.202176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.202324] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.203518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.203518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.203518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.203518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.203518] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df955150-4015-4c07-90e5-0a793c5a1b3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.203925] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2c2db01-c415-49e8-b688-dc482fcaaac6 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.203925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2c2db01-c415-49e8-b688-dc482fcaaac6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.204130] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2c2db01-c415-49e8-b688-dc482fcaaac6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.204160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2c2db01-c415-49e8-b688-dc482fcaaac6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.204295] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c2db01-c415-49e8-b688-dc482fcaaac6',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.364766] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.364970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.364970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.366244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.366244] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.366244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.366244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.366244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.366244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.366244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.366244] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.366244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.366244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.366870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.366870] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.366870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.366870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.366870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.366870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.367091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.367091] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.705600] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df955150-4015-4c07-90e5-0a793c5a1b3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.706859] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-df955150-4015-4c07-90e5-0a793c5a1b3b taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.707021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.709530] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2c2db01-c415-49e8-b688-dc482fcaaac6 with status ACTIVE [ 742.709797] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.709932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.710008] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.710285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.710391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.710574] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.710675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.710740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.710898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.710976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.711271] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.711366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.711431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.711589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.711708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.711796] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2c2db01-c415-49e8-b688-dc482fcaaac6 is going to be updated. [ 742.732532] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.732760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.732760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.733012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.733178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.733353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2c2db01-c415-49e8-b688-dc482fcaaac6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.851964] env[69647]: INFO networking_nsxv3.common.synchronization [None req-1274d3b8-1892-49c2-8209-8ca41352ef20 None None] Enqueued Resource ID: 8413a73f-ad22-4ee5-bb10-257fe566c88b with Priority: HIGHEST for action port [ 742.852262] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8413a73f-ad22-4ee5-bb10-257fe566c88b with Priority: HIGHEST for action port [ 742.853269] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-8413a73f-ad22-4ee5-bb10-257fe566c88b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.853383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8413a73f-ad22-4ee5-bb10-257fe566c88b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.853383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8413a73f-ad22-4ee5-bb10-257fe566c88b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.853691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8413a73f-ad22-4ee5-bb10-257fe566c88b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.853691] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8413a73f-ad22-4ee5-bb10-257fe566c88b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.871530] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 326bee86-2025-4239-98be-95f9262ac7a3: rpc.has_security_group_logging(os_id): False [ 742.889159] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.889349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.889349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.889582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.889668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.889875] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.889982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.890058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.890175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.890242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.890434] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.890532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.890604] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.890705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.890763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.890939] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.891230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.891335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.891477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.891547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.891639] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 742.952304] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.952304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.952304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.952304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.952304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.965182] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 743.210126] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df955150-4015-4c07-90e5-0a793c5a1b3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.356966] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8413a73f-ad22-4ee5-bb10-257fe566c88b [ 743.357313] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.357643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.357698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.357886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.357975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.358283] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8413a73f-ad22-4ee5-bb10-257fe566c88b already deleted. [ 743.358283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8413a73f-ad22-4ee5-bb10-257fe566c88b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.714676] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.714832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.714901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.715130] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.715218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.715319] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df955150-4015-4c07-90e5-0a793c5a1b3b is going to be created. [ 743.753986] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.753986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.753986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.753986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.754306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.767050] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df955150-4015-4c07-90e5-0a793c5a1b3b in Status: UNINITIALIZED for 2s [ 744.175417] env[69647]: INFO networking_nsxv3.common.synchronization [None req-d755506b-3f68-457b-81ea-93d5902bb50c tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_rules [ 744.176372] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_rules [ 744.177295] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.177527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.177606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.177929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.178028] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.292829] env[69647]: INFO networking_nsxv3.common.synchronization [None req-f5350075-804a-4f1f-b6e6-7d2499072abf tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_rules [ 744.292829] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_rules [ 744.292829] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.292829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.711774] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.711774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.711774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.711774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.711774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.711774] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a already deleted. [ 744.711774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.711774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.711774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.711774] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.753028] env[69647]: INFO networking_nsxv3.common.synchronization [None req-5ee6e812-0fc5-469b-8590-ee999627451e None None] Enqueued Resource ID: 2047bcc7-c6ba-4a24-a29f-0410decf67e8 with Priority: HIGHEST for action port [ 744.757077] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2047bcc7-c6ba-4a24-a29f-0410decf67e8 with Priority: HIGHEST for action port [ 744.757077] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-2047bcc7-c6ba-4a24-a29f-0410decf67e8 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.757077] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2047bcc7-c6ba-4a24-a29f-0410decf67e8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.757077] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2047bcc7-c6ba-4a24-a29f-0410decf67e8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.757077] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2047bcc7-c6ba-4a24-a29f-0410decf67e8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.757077] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2047bcc7-c6ba-4a24-a29f-0410decf67e8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.982882] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 744.983302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.241812] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.241969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.242026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.242279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.242405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.242527] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a already deleted. [ 745.242621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.263386] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2047bcc7-c6ba-4a24-a29f-0410decf67e8 [ 745.263386] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.263386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.263386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.263386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.263386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.263386] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2047bcc7-c6ba-4a24-a29f-0410decf67e8 already deleted. [ 745.263386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2047bcc7-c6ba-4a24-a29f-0410decf67e8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.776851] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df955150-4015-4c07-90e5-0a793c5a1b3b in Status: SUCCESS [ 745.777262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.777262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.777504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.777697] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.777883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.778024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.778270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.778446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.778446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.778511] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df955150-4015-4c07-90e5-0a793c5a1b3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.927802] env[69647]: INFO networking_nsxv3.common.synchronization [req-45690773-b616-4c08-84d9-33c7cc009306 req-6400901c-8dd6-4662-9317-b783ed0c2320 tempest-VolumesAdminNegativeTest-778557798 tempest-VolumesAdminNegativeTest-778557798-project-member] Enqueued Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_members [ 745.929098] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_members [ 745.930257] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-4691b465-a6c4-42d2-86ce-653d3dc9c97e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.930455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.930561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.930928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.933351] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.933351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.933351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.933351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.933351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.933351] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.234832] env[69647]: INFO networking_nsxv3.common.synchronization [req-badec90b-83be-4644-a681-b34637680baa req-a72f17b4-12f0-4103-8b30-55939a9b50eb tempest-ServersAdminNegativeTestJSON-19627888 tempest-ServersAdminNegativeTestJSON-19627888-project-member] Enqueued Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 746.235461] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c01b37-5156-42f7-b415-81d83f30f935 with Priority: HIGHEST for action security_group_members [ 746.235812] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9c01b37-5156-42f7-b415-81d83f30f935 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.235961] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.236140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.237234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.237234] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.237234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.237234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.237234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.237234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.237622] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9c01b37-5156-42f7-b415-81d83f30f935',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.281337] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df955150-4015-4c07-90e5-0a793c5a1b3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.420371] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.420603] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-309" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.420752] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-309" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.421256] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-309" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.421572] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.421738] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.421852] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.422115] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.422285] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.422546] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.422689] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.422819] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.422943] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.423157] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.423431] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.423431] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.433708] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.433892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.433966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.434250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.434360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.434600] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.434731] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.434823] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.435030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.435095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.435182] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e already deleted. [ 746.435275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.442238] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.442476] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 746.442653] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.442904] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-309" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.443299] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-554aea57-f2c3-473a-b5d6-05499bf66a68 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.443539] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-554aea57-f2c3-473a-b5d6-05499bf66a68" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.443678] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-554aea57-f2c3-473a-b5d6-05499bf66a68" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.444019] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-554aea57-f2c3-473a-b5d6-05499bf66a68" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.444171] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('554aea57-f2c3-473a-b5d6-05499bf66a68',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.739972] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.740083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.740118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.740457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.740641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.740858] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.742208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.742208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.742208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.742208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.742208] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9c01b37-5156-42f7-b415-81d83f30f935 is going to be updated. [ 746.769645] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.769783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.769852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.770121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.770267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.781367] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: IN_PROGRESS for 2s [ 746.782753] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df955150-4015-4c07-90e5-0a793c5a1b3b: rpc.has_security_group_logging(os_id): False [ 746.799150] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.799331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.799443] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.799649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.799741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.800014] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.800113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.800180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.800439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.800549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.800651] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df955150-4015-4c07-90e5-0a793c5a1b3b is going to be created. [ 746.879941] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.880361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.880361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.881050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.881050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.891689] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df955150-4015-4c07-90e5-0a793c5a1b3b in Status: IN_PROGRESS for 2s [ 746.946566] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.946566] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.947273] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.947273] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.947407] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.947605] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 554aea57-f2c3-473a-b5d6-05499bf66a68 not found, creating... [ 746.948747] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.948884] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.949043] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.949340] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.949510] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.950474] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.950736] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.950906] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.951219] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.951408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.951588] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 554aea57-f2c3-473a-b5d6-05499bf66a68 is going to be created. [ 746.984137] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.984410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.984623] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.984941] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.985245] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.985527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-554aea57-f2c3-473a-b5d6-05499bf66a68" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.696925] env[69647]: INFO networking_nsxv3.common.synchronization [req-45690773-b616-4c08-84d9-33c7cc009306 req-d20531ba-686b-485a-8555-c6cda4af7161 service nova] Enqueued Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_rules [ 747.697124] env[69647]: INFO networking_nsxv3.common.synchronization [req-45690773-b616-4c08-84d9-33c7cc009306 req-d20531ba-686b-485a-8555-c6cda4af7161 service nova] Enqueued Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_members [ 747.697266] env[69647]: INFO networking_nsxv3.common.synchronization [req-45690773-b616-4c08-84d9-33c7cc009306 req-d20531ba-686b-485a-8555-c6cda4af7161 service nova] Enqueued Resource ID: 554aea57-f2c3-473a-b5d6-05499bf66a68 with Priority: HIGHEST for action port [ 747.697493] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_rules [ 747.697620] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_members [ 747.697720] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 554aea57-f2c3-473a-b5d6-05499bf66a68 with Priority: HIGHEST for action port [ 747.698318] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.698398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.698487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.698638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.698703] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.699662] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-4691b465-a6c4-42d2-86ce-653d3dc9c97e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.699815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.699815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.700030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.700145] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.700232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.700298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.700422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.700501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.700588] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.701357] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-554aea57-f2c3-473a-b5d6-05499bf66a68 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.701481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-554aea57-f2c3-473a-b5d6-05499bf66a68" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.701536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-554aea57-f2c3-473a-b5d6-05499bf66a68" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.702155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-554aea57-f2c3-473a-b5d6-05499bf66a68" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.702155] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('554aea57-f2c3-473a-b5d6-05499bf66a68',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.203119] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-4691b465-a6c4-42d2-86ce-653d3dc9c97e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.203483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.203483] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.204469] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 554aea57-f2c3-473a-b5d6-05499bf66a68 with status ACTIVE [ 748.204639] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.204724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.204769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.204971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.205072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.205543] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.205543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.205543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.205941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.206038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.206244] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.206756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.206756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.206756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.206756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.206756] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 554aea57-f2c3-473a-b5d6-05499bf66a68 is going to be updated. [ 748.228779] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.228930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.229380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.229380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.229380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.229572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-554aea57-f2c3-473a-b5d6-05499bf66a68" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.709114] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.790836] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9c01b37-5156-42f7-b415-81d83f30f935 in Status: SUCCESS [ 748.791042] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9c01b37-5156-42f7-b415-81d83f30f935 deletion is rescheduled due to dependency. [ 748.791202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9c01b37-5156-42f7-b415-81d83f30f935" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.903879] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df955150-4015-4c07-90e5-0a793c5a1b3b in Status: SUCCESS [ 748.904143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.211758] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.212114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.212114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.212625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.212625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.212625] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e is going to be created. [ 749.235885] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.236035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.236134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.236606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.236606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.244623] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e in Status: UNINITIALIZED for 2s [ 750.783439] env[69647]: INFO networking_nsxv3.common.synchronization [req-3884f397-e348-4396-9e4d-652800eda621 req-ab1a874f-f19f-4c81-bf78-a4332da80763 tempest-ServerPasswordTestJSON-2041505529 tempest-ServerPasswordTestJSON-2041505529-project-member] Enqueued Resource ID: cd53af51-8db9-4653-95a6-3f457b519312 with Priority: HIGHEST for action security_group_members [ 750.790568] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd53af51-8db9-4653-95a6-3f457b519312 with Priority: HIGHEST for action security_group_members [ 750.790568] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd53af51-8db9-4653-95a6-3f457b519312 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.790568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.790568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.790568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.790568] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.792115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.792115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.792115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.792115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.792115] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd53af51-8db9-4653-95a6-3f457b519312',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.183314] env[69647]: INFO networking_nsxv3.common.synchronization [None req-44e3a064-0404-4e6d-829b-3bd2512e5345 None None] Enqueued Resource ID: 1e4a7f14-29ed-4859-bf15-cc4a6fcbcaf2 with Priority: HIGHEST for action port [ 751.183606] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4a7f14-29ed-4859-bf15-cc4a6fcbcaf2 with Priority: HIGHEST for action port [ 751.184222] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e4a7f14-29ed-4859-bf15-cc4a6fcbcaf2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.184358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e4a7f14-29ed-4859-bf15-cc4a6fcbcaf2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.184425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e4a7f14-29ed-4859-bf15-cc4a6fcbcaf2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.184719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e4a7f14-29ed-4859-bf15-cc4a6fcbcaf2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.184805] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e4a7f14-29ed-4859-bf15-cc4a6fcbcaf2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.256524] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e in Status: SUCCESS [ 751.256617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.256798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.256987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.258369] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.258369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.258369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.258369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.258369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.258369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.258369] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.295738] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.297020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.297020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.297020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.297020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.297020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.297020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.297020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.297020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.297020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.297020] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd53af51-8db9-4653-95a6-3f457b519312 already deleted. [ 751.297020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.329846] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-17 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.330046] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-17" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.330178] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-17" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.330527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-17" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.330736] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.330889] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.332824] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.332824] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.332824] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.332824] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.332824] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.332824] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.332824] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.332824] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.332824] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.332824] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.353881] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.354834] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 751.354834] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.354834] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-17" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.354834] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-e950cf12-f892-45ff-966f-8da1bd0691f0 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.354834] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-e950cf12-f892-45ff-966f-8da1bd0691f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.355117] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-e950cf12-f892-45ff-966f-8da1bd0691f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.355290] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-e950cf12-f892-45ff-966f-8da1bd0691f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.355427] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e950cf12-f892-45ff-966f-8da1bd0691f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.690066] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e4a7f14-29ed-4859-bf15-cc4a6fcbcaf2 [ 751.690066] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.690066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.690066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.690344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.690344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.690344] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e4a7f14-29ed-4859-bf15-cc4a6fcbcaf2 already deleted. [ 751.690446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e4a7f14-29ed-4859-bf15-cc4a6fcbcaf2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.759845] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.858361] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.858659] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.858728] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.858961] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.859131] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.859284] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port e950cf12-f892-45ff-966f-8da1bd0691f0 not found, creating... [ 751.859540] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.859697] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.859810] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.860048] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.860184] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.860458] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.860607] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.860721] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.864018] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.864018] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.864018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: e950cf12-f892-45ff-966f-8da1bd0691f0 is going to be created. [ 751.883171] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.883171] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.883171] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.883171] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.883171] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.883171] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-e950cf12-f892-45ff-966f-8da1bd0691f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.263670] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4691b465-a6c4-42d2-86ce-653d3dc9c97e: rpc.has_security_group_logging(os_id): False [ 752.283661] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.283661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.283901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.283944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.284028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.284383] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.284383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.284543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.284607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.284686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.284780] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e is going to be created. [ 752.340438] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.340438] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.340438] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.340438] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.340438] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.350376] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e in Status: IN_PROGRESS for 2s [ 752.424474] env[69647]: INFO networking_nsxv3.common.synchronization [None req-a7a6b3ba-934e-4b67-a87a-219e78df9ad4 tempest-AttachVolumeTestJSON-1527312667 tempest-AttachVolumeTestJSON-1527312667-project-member] Enqueued Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_rules [ 752.424999] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_rules [ 752.425306] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80142545-bab7-4367-b0e0-40b8e04f4503 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.425427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.425494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.425802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.426158] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.664357] env[69647]: INFO networking_nsxv3.common.synchronization [None req-24b3f8d1-31a8-41e4-9b83-ff832b4183c6 tempest-AttachVolumeTestJSON-1527312667 tempest-AttachVolumeTestJSON-1527312667-project-member] Enqueued Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_rules [ 752.664891] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_rules [ 752.665211] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80142545-bab7-4367-b0e0-40b8e04f4503 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.665293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.950974] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.951336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.951431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.951662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.951755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.951850] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80142545-bab7-4367-b0e0-40b8e04f4503 already deleted. [ 752.951934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.952153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.952317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.952421] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.212860] env[69647]: INFO networking_nsxv3.common.synchronization [req-3884f397-e348-4396-9e4d-652800eda621 req-3ed05fd4-cb5d-4204-92a9-8e8a282c2a1f service nova] Enqueued Resource ID: cd53af51-8db9-4653-95a6-3f457b519312 with Priority: HIGHEST for action security_group_rules [ 753.214924] env[69647]: INFO networking_nsxv3.common.synchronization [req-3884f397-e348-4396-9e4d-652800eda621 req-3ed05fd4-cb5d-4204-92a9-8e8a282c2a1f service nova] Enqueued Resource ID: cd53af51-8db9-4653-95a6-3f457b519312 with Priority: HIGHEST for action security_group_members [ 753.214924] env[69647]: INFO networking_nsxv3.common.synchronization [req-3884f397-e348-4396-9e4d-652800eda621 req-3ed05fd4-cb5d-4204-92a9-8e8a282c2a1f service nova] Enqueued Resource ID: e950cf12-f892-45ff-966f-8da1bd0691f0 with Priority: HIGHEST for action port [ 753.214924] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd53af51-8db9-4653-95a6-3f457b519312 with Priority: HIGHEST for action security_group_rules [ 753.214924] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd53af51-8db9-4653-95a6-3f457b519312 with Priority: HIGHEST for action security_group_members [ 753.214924] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e950cf12-f892-45ff-966f-8da1bd0691f0 with Priority: HIGHEST for action port [ 753.214924] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd53af51-8db9-4653-95a6-3f457b519312 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.214924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.214924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.214924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.215445] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd53af51-8db9-4653-95a6-3f457b519312',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.219731] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd53af51-8db9-4653-95a6-3f457b519312 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.219731] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.219831] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.219986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.220152] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.220249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.220307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.220449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.220526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.220617] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd53af51-8db9-4653-95a6-3f457b519312',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.221543] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-e950cf12-f892-45ff-966f-8da1bd0691f0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.222284] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e950cf12-f892-45ff-966f-8da1bd0691f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.222284] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e950cf12-f892-45ff-966f-8da1bd0691f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.222284] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e950cf12-f892-45ff-966f-8da1bd0691f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.222284] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e950cf12-f892-45ff-966f-8da1bd0691f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.475803] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.475970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.476090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.477373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.477504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.477625] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80142545-bab7-4367-b0e0-40b8e04f4503 already deleted. [ 753.477713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.514041] env[69647]: INFO networking_nsxv3.common.synchronization [req-dd28d316-1c13-4b0e-bba1-9b3039fc20dc req-b2cbc585-3af4-4bc0-b7bf-7712e1bf5ccd tempest-ServersAdminTestJSON-1923625429 tempest-ServersAdminTestJSON-1923625429-project-member] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 753.514553] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 753.514888] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.515019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.515106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.515359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.515509] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.515605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.515833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.515833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.515920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.515969] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.604421] env[69647]: INFO networking_nsxv3.common.synchronization [None req-5e8fac68-2631-4e9c-8a1f-7e87eadf7cde None None] Enqueued Resource ID: 91da9208-3a5a-4bac-89ec-b44759f27557 with Priority: HIGHEST for action port [ 753.604955] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91da9208-3a5a-4bac-89ec-b44759f27557 with Priority: HIGHEST for action port [ 753.605260] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-91da9208-3a5a-4bac-89ec-b44759f27557 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.605385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91da9208-3a5a-4bac-89ec-b44759f27557" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.605443] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91da9208-3a5a-4bac-89ec-b44759f27557" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.605682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91da9208-3a5a-4bac-89ec-b44759f27557" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.605764] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91da9208-3a5a-4bac-89ec-b44759f27557',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.724168] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd53af51-8db9-4653-95a6-3f457b519312 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.724168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.729283] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd53af51-8db9-4653-95a6-3f457b519312',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.729283] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e950cf12-f892-45ff-966f-8da1bd0691f0 with status ACTIVE [ 753.729283] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.729283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.729283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.729283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.729283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.729283] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.729283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.729283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.729283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.729283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.729283] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.729283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.729283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.729283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.729795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.729795] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e950cf12-f892-45ff-966f-8da1bd0691f0 is going to be updated. [ 753.751666] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.751666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.751666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.751666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.751666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.751666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e950cf12-f892-45ff-966f-8da1bd0691f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.836145] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-593 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.836145] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.836145] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.836145] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.836145] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.836145] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.836656] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.837030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.837298] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.837778] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.840074] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.840074] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.840074] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.840074] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.840074] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.840074] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.857753] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.857939] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 753.858113] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.858322] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.858651] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1831c802-20d7-44c2-a803-e14aa6186ddd taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.858821] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1831c802-20d7-44c2-a803-e14aa6186ddd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.858936] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1831c802-20d7-44c2-a803-e14aa6186ddd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.859301] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1831c802-20d7-44c2-a803-e14aa6186ddd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.859451] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1831c802-20d7-44c2-a803-e14aa6186ddd',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.021879] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.021879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.021879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.022363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.022363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.022363] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.022363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.022520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.022568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.023209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.023209] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 already deleted. [ 754.023209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.110498] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91da9208-3a5a-4bac-89ec-b44759f27557 [ 754.110801] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.110960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.111065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.111365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.111465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.111578] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91da9208-3a5a-4bac-89ec-b44759f27557 already deleted. [ 754.111668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91da9208-3a5a-4bac-89ec-b44759f27557" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.233169] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd53af51-8db9-4653-95a6-3f457b519312',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.362547] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e in Status: SUCCESS [ 754.362770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.365782] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.365961] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.365961] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.366224] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.366478] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.366597] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1831c802-20d7-44c2-a803-e14aa6186ddd not found, creating... [ 754.366951] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.367650] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.367650] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.367650] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.367650] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.367949] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.368113] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.368284] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.368530] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.368738] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.368812] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1831c802-20d7-44c2-a803-e14aa6186ddd is going to be created. [ 754.388052] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.388286] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.388523] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.388919] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.389449] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.390137] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1831c802-20d7-44c2-a803-e14aa6186ddd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.737526] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.737693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.737742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.737957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.738061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.738160] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd53af51-8db9-4653-95a6-3f457b519312 is going to be created. [ 754.760251] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.760397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.760467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.760686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.760849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.770351] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd53af51-8db9-4653-95a6-3f457b519312 in Status: UNINITIALIZED for 2s [ 755.078289] env[69647]: INFO networking_nsxv3.common.synchronization [req-dd28d316-1c13-4b0e-bba1-9b3039fc20dc req-7eb5486c-5610-4b61-9d2c-db203255c9cb service nova] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_rules [ 755.078641] env[69647]: INFO networking_nsxv3.common.synchronization [req-dd28d316-1c13-4b0e-bba1-9b3039fc20dc req-7eb5486c-5610-4b61-9d2c-db203255c9cb service nova] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 755.078641] env[69647]: INFO networking_nsxv3.common.synchronization [req-dd28d316-1c13-4b0e-bba1-9b3039fc20dc req-7eb5486c-5610-4b61-9d2c-db203255c9cb service nova] Enqueued Resource ID: 1831c802-20d7-44c2-a803-e14aa6186ddd with Priority: HIGHEST for action port [ 755.078861] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_rules [ 755.078978] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 755.079181] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1831c802-20d7-44c2-a803-e14aa6186ddd with Priority: HIGHEST for action port [ 755.079975] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.080191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.080290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.080692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.080806] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.082137] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.082212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.082401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.083036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.083036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.083036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.083201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.083306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.083469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.083582] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.084624] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1831c802-20d7-44c2-a803-e14aa6186ddd taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.084780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1831c802-20d7-44c2-a803-e14aa6186ddd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.084859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1831c802-20d7-44c2-a803-e14aa6186ddd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.085024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1831c802-20d7-44c2-a803-e14aa6186ddd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.085103] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1831c802-20d7-44c2-a803-e14aa6186ddd',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.587831] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.587967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.588203] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.593228] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1831c802-20d7-44c2-a803-e14aa6186ddd with status ACTIVE [ 755.593228] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.593228] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.593228] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.593489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.593489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.593557] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.593642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.593704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.593839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.593916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.594201] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.594347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.594422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.594566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.594639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.594722] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1831c802-20d7-44c2-a803-e14aa6186ddd is going to be updated. [ 755.615401] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.615535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.615666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.616017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.616176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.616338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1831c802-20d7-44c2-a803-e14aa6186ddd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.097615] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.137436] env[69647]: INFO networking_nsxv3.common.synchronization [req-7ed8dbc4-e2a9-4a55-afae-e8bcc2ba47ea req-a3f5c869-ac51-4279-866b-21daa2a9728a tempest-ImagesTestJSON-954996409 tempest-ImagesTestJSON-954996409-project-member] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 756.137436] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 756.137436] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.137436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.138047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.138320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.138548] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.138716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.138822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.139030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.139191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.139342] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.603554] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.603726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.603768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.603991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.604117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.604234] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be created. [ 756.643787] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.643908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.643980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.644220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.644372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.645538] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.645662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.645721] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.645861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.645934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.646412] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.646537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.646597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.646709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.646781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.646863] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 756.660358] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: UNINITIALIZED for 2s [ 756.673797] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.673973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.674027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.674272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.674425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.683061] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 756.779919] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd53af51-8db9-4653-95a6-3f457b519312 in Status: SUCCESS [ 756.780168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.781338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.781338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.781338] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.781338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.781338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.781338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.781338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.781338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.781868] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd53af51-8db9-4653-95a6-3f457b519312',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.284016] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd53af51-8db9-4653-95a6-3f457b519312 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.288202] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.288202] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd53af51-8db9-4653-95a6-3f457b519312 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.288202] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.288202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.289685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.289685] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd53af51-8db9-4653-95a6-3f457b519312',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.789115] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd53af51-8db9-4653-95a6-3f457b519312: rpc.has_security_group_logging(os_id): False [ 757.807164] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.807164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.807164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.807164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.807164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.807164] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.807164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.807164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.807164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.807164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.807621] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.807621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.807621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.807621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.807621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.807844] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.807844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.807924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.816019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.816019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.816019] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd53af51-8db9-4653-95a6-3f457b519312 is going to be created. [ 757.872286] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.872533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.872683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.872946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.873186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.884386] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd53af51-8db9-4653-95a6-3f457b519312 in Status: IN_PROGRESS for 2s [ 758.252267] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ba1c301-7290-4848-8bfa-4e98dccd249f req-3fe93f96-2dc0-44cb-a15d-59125ad96fff tempest-ServersTestFqdnHostnames-1719574557 tempest-ServersTestFqdnHostnames-1719574557-project-member] Enqueued Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_members [ 758.253116] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_members [ 758.253597] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.254513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.254513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.254513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.254513] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.254513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.254883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.254883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.254883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.254883] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c1ac393-0d0d-48c1-adc3-b358d19ecbca',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.670097] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 758.670337] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.671224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.671224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.671224] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.672038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.672137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.672357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.672878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.672878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.672878] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.694142] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 758.694333] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 deletion is rescheduled due to dependency. [ 758.694542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.754640] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-163 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.755437] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-163" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.756058] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-163" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.756429] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-163" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.756890] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.757502] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.757502] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.757755] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.757855] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.758150] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 758.758272] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.758576] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.760018] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.760528] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 758.760908] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.760908] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.762766] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.762888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.762942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.763141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.763539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.763752] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.764190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.764190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.764480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.764625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.764678] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca already deleted. [ 758.764756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.781666] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.783107] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 758.783107] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.783107] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-163" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.783107] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-33754473-b2d8-4709-822e-38441b767477 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.783107] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-33754473-b2d8-4709-822e-38441b767477" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.784053] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-33754473-b2d8-4709-822e-38441b767477" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.784467] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-33754473-b2d8-4709-822e-38441b767477" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.784853] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33754473-b2d8-4709-822e-38441b767477',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.174986] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.178020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.178020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.178020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.178020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.181135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.181452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.182084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.182084] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.287537] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.288374] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.288665] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.288905] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.289093] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.289354] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 33754473-b2d8-4709-822e-38441b767477 not found, creating... [ 759.289595] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.289782] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.289895] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.290127] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.290261] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.290674] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.290674] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.290873] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.290986] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.291925] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.292397] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 33754473-b2d8-4709-822e-38441b767477 is going to be created. [ 759.311366] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.312586] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.312768] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.313069] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.313303] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.313549] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-33754473-b2d8-4709-822e-38441b767477" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.685011] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27b912c1-294b-407e-bd8a-c81f04912b02: rpc.has_security_group_logging(os_id): False [ 759.702334] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.702581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.702755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.703177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.703177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.703429] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.703964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.704361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.704821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.704821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.705588] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.706442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.706566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.706767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.706949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.707264] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.708172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.708402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.708627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.710983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.711108] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be created. [ 759.768140] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.768291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.768359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.768573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.768750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.778533] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 759.897443] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd53af51-8db9-4653-95a6-3f457b519312 in Status: SUCCESS [ 759.897867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.013440] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ba1c301-7290-4848-8bfa-4e98dccd249f req-a3641f8e-ef81-41ed-bcef-abd745898bae service nova] Enqueued Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_rules [ 760.013440] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ba1c301-7290-4848-8bfa-4e98dccd249f req-a3641f8e-ef81-41ed-bcef-abd745898bae service nova] Enqueued Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_members [ 760.013640] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ba1c301-7290-4848-8bfa-4e98dccd249f req-a3641f8e-ef81-41ed-bcef-abd745898bae service nova] Enqueued Resource ID: 33754473-b2d8-4709-822e-38441b767477 with Priority: HIGHEST for action port [ 760.014566] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_rules [ 760.014566] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_members [ 760.014566] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33754473-b2d8-4709-822e-38441b767477 with Priority: HIGHEST for action port [ 760.014566] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.014998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.014998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.014998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.014998] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c1ac393-0d0d-48c1-adc3-b358d19ecbca',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.016229] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.016379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.016472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.016774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.016963] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.017104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.017192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.017367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.017506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.017639] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c1ac393-0d0d-48c1-adc3-b358d19ecbca',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.018593] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-33754473-b2d8-4709-822e-38441b767477 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.018752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33754473-b2d8-4709-822e-38441b767477" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.018825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33754473-b2d8-4709-822e-38441b767477" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.020019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33754473-b2d8-4709-822e-38441b767477" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.020019] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33754473-b2d8-4709-822e-38441b767477',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.521123] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33754473-b2d8-4709-822e-38441b767477 with status ACTIVE [ 760.521427] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.521565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.521636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.521856] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.521946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.522142] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.522243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.522336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.522448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.522523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.522753] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.522853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.522913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.523066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.523160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.523245] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33754473-b2d8-4709-822e-38441b767477 is going to be updated. [ 760.524803] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c1ac393-0d0d-48c1-adc3-b358d19ecbca',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.525967] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.525967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.545035] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.545190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.545248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.545467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.545622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.545868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33754473-b2d8-4709-822e-38441b767477" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.026958] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c1ac393-0d0d-48c1-adc3-b358d19ecbca',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.533030] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.533030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.533030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.533030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.533030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.533030] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca is going to be created. [ 761.556688] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.556848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.556965] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.557201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.557375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.566386] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca in Status: UNINITIALIZED for 2s [ 761.794805] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 761.794970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.259041] env[69647]: INFO networking_nsxv3.common.synchronization [req-cb734dfd-bc0a-4d4a-86c6-cba365ffecc7 req-d6a5b448-b310-4a13-9f47-d94adac76a9f tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 762.259041] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 762.259041] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.259041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.259041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.263628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.264595] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.264595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.264595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.264595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.264595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.264595] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.769039] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.769039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.769039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.769039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.769039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.769039] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.769039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.769039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.769533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.770385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.770385] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 762.795791] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.796052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.796052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.796225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.796538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.804665] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 762.871644] env[69647]: INFO networking_nsxv3.common.synchronization [req-d7121688-c0e6-4c3d-9a5d-353edfde7aea req-1d187572-b0ca-41f6-b205-377974e6bef0 tempest-ServersAdminTestJSON-1923625429 tempest-ServersAdminTestJSON-1923625429-project-member] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 762.871771] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 762.872086] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.872232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.872354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.872591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.872946] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.873065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.873131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.873309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.873434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.874069] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.199741] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-593 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.199932] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.200101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.200362] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.200624] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.200780] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.200894] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.202050] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.202827] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.203101] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.204425] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.204563] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.204679] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.204801] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 763.204911] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.205183] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.226390] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.227040] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 763.227040] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.227040] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.227663] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-a8324e95-a42e-4bd9-9aa9-ead35b6946c4 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.227663] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-a8324e95-a42e-4bd9-9aa9-ead35b6946c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.227663] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-a8324e95-a42e-4bd9-9aa9-ead35b6946c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.227985] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-a8324e95-a42e-4bd9-9aa9-ead35b6946c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.228104] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8324e95-a42e-4bd9-9aa9-ead35b6946c4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.376908] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.576219] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca in Status: SUCCESS [ 763.576219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.576466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.576772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.577044] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.577217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.577327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.577537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.577665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.577788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.577944] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c1ac393-0d0d-48c1-adc3-b358d19ecbca',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.731007] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.731302] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.731447] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.731718] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.731867] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.732032] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port a8324e95-a42e-4bd9-9aa9-ead35b6946c4 not found, creating... [ 763.732308] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.732463] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.732576] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.732791] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.732926] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.733220] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.733377] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.733593] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.733983] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.734144] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.734287] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: a8324e95-a42e-4bd9-9aa9-ead35b6946c4 is going to be created. [ 763.754651] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.754899] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.755041] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.755314] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.755550] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.755777] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-a8324e95-a42e-4bd9-9aa9-ead35b6946c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.881066] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.082099] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c1ac393-0d0d-48c1-adc3-b358d19ecbca',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.385600] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.385600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.385600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.385600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.385600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.386262] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 764.418010] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.418010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.418010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.418010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.418010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.425786] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 764.587267] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c1ac393-0d0d-48c1-adc3-b358d19ecbca: rpc.has_security_group_logging(os_id): False [ 764.591064] env[69647]: INFO networking_nsxv3.common.synchronization [req-d7121688-c0e6-4c3d-9a5d-353edfde7aea req-e644814a-4e48-4442-831d-93ca96ed6a9d service nova] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_rules [ 764.591064] env[69647]: INFO networking_nsxv3.common.synchronization [req-d7121688-c0e6-4c3d-9a5d-353edfde7aea req-e644814a-4e48-4442-831d-93ca96ed6a9d service nova] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 764.592031] env[69647]: INFO networking_nsxv3.common.synchronization [req-d7121688-c0e6-4c3d-9a5d-353edfde7aea req-e644814a-4e48-4442-831d-93ca96ed6a9d service nova] Enqueued Resource ID: a8324e95-a42e-4bd9-9aa9-ead35b6946c4 with Priority: HIGHEST for action port [ 764.595063] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_rules [ 764.595063] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 764.595063] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8324e95-a42e-4bd9-9aa9-ead35b6946c4 with Priority: HIGHEST for action port [ 764.595063] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.595063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.595063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.595063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.595063] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.595063] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.595063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.595063] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8324e95-a42e-4bd9-9aa9-ead35b6946c4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.595537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8324e95-a42e-4bd9-9aa9-ead35b6946c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.595537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8324e95-a42e-4bd9-9aa9-ead35b6946c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.596153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8324e95-a42e-4bd9-9aa9-ead35b6946c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.596153] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8324e95-a42e-4bd9-9aa9-ead35b6946c4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.610251] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.610398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.610520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.610716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.610809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.611083] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.611266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.611328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.611485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.611568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.611676] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca is going to be created. [ 764.678773] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.680404] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.680595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.680924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.681178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.695583] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca in Status: IN_PROGRESS for 2s [ 764.814627] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 764.815125] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 deletion is rescheduled due to dependency. [ 764.815261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.097531] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.097681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.107433] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8324e95-a42e-4bd9-9aa9-ead35b6946c4 with status ACTIVE [ 765.107676] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.107833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.107907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.108168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.108265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.108440] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.108551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.108616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.108771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.108863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.109077] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.109236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.109312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.109437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.109513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.109601] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8324e95-a42e-4bd9-9aa9-ead35b6946c4 is going to be updated. [ 765.114552] env[69647]: INFO networking_nsxv3.common.synchronization [None req-528b815b-2a6f-4020-9e3d-421bd0160f49 None None] Enqueued Resource ID: a63dee28-f2f1-4716-a564-3235a328d186 with Priority: HIGHEST for action port [ 765.116020] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63dee28-f2f1-4716-a564-3235a328d186 with Priority: HIGHEST for action port [ 765.116575] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a63dee28-f2f1-4716-a564-3235a328d186 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.116741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a63dee28-f2f1-4716-a564-3235a328d186" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.116879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a63dee28-f2f1-4716-a564-3235a328d186" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.117209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a63dee28-f2f1-4716-a564-3235a328d186" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.117298] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a63dee28-f2f1-4716-a564-3235a328d186',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.136398] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.136545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.136642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.136858] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.137040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.137231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8324e95-a42e-4bd9-9aa9-ead35b6946c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.619926] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a63dee28-f2f1-4716-a564-3235a328d186 [ 765.620249] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.620369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.620482] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.620695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.620812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.620926] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a63dee28-f2f1-4716-a564-3235a328d186 already deleted. [ 765.621021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a63dee28-f2f1-4716-a564-3235a328d186" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.435075] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 766.435361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.435593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.435896] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.436397] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.436397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.436550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.436622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.436729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.436857] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.693060] env[69647]: INFO networking_nsxv3.common.synchronization [req-2a08a8d9-2e8f-4e6a-93ed-6b67ea609f8e req-2f1638fe-e5ab-4337-b931-57ebbce1d5ca tempest-ServerPasswordTestJSON-2041505529 tempest-ServerPasswordTestJSON-2041505529-project-member] Enqueued Resource ID: cd53af51-8db9-4653-95a6-3f457b519312 with Priority: HIGHEST for action security_group_members [ 766.695242] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd53af51-8db9-4653-95a6-3f457b519312 with Priority: HIGHEST for action security_group_members [ 766.695552] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd53af51-8db9-4653-95a6-3f457b519312 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.695679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.695745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.695948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.696909] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.696909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.696909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.696909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.696909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.696909] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd53af51-8db9-4653-95a6-3f457b519312',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.708850] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca in Status: SUCCESS [ 766.709108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.939783] env[69647]: INFO networking_nsxv3.common.synchronization [None req-2ce89d86-3a33-411d-a195-1d942d399606 None None] Enqueued Resource ID: 88196343-037a-457d-bde6-3c987a29eafc with Priority: HIGHEST for action port [ 766.940311] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88196343-037a-457d-bde6-3c987a29eafc with Priority: HIGHEST for action port [ 766.940629] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-88196343-037a-457d-bde6-3c987a29eafc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.940753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88196343-037a-457d-bde6-3c987a29eafc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.940814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88196343-037a-457d-bde6-3c987a29eafc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.943132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88196343-037a-457d-bde6-3c987a29eafc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.943132] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88196343-037a-457d-bde6-3c987a29eafc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.943132] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.206760] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.206760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.206760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.206760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.206760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.206760] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.206760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.206760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.206760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.206760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.206760] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd53af51-8db9-4653-95a6-3f457b519312 is going to be updated. [ 767.234891] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.234891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.234891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.235241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.238145] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.244544] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd53af51-8db9-4653-95a6-3f457b519312 in Status: IN_PROGRESS for 2s [ 767.445077] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88196343-037a-457d-bde6-3c987a29eafc [ 767.445343] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.445484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.445583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.445770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.445862] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.445954] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88196343-037a-457d-bde6-3c987a29eafc already deleted. [ 767.446046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88196343-037a-457d-bde6-3c987a29eafc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.449485] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.953117] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.953117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.953117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.953117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.953117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.953117] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 767.979189] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.979411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.979498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.979729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.979875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.987999] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 769.255672] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd53af51-8db9-4653-95a6-3f457b519312 in Status: SUCCESS [ 769.255672] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd53af51-8db9-4653-95a6-3f457b519312 deletion is rescheduled due to dependency. [ 769.255672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd53af51-8db9-4653-95a6-3f457b519312" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.000742] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 770.000955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.001141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.001444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.001637] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.001758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.001827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.001986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.002082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.002168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.002269] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.506727] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.506727] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.506727] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.507775] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.507775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.507775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.507775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.507775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.507775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.507775] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.773604] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-745bc17c-cf48-4075-b49c-1947aee0612c tempest-ServersTestMultiNic-870967946 tempest-ServersTestMultiNic-870967946-project-member] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 770.774826] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 770.774826] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.774826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.774826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.779460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.779460] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.779576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.779820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.779892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.779930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.780028] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.012738] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27b912c1-294b-407e-bd8a-c81f04912b02: rpc.has_security_group_logging(os_id): False [ 771.034413] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.034561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.034635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.034847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.034975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.035210] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.035330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.035374] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.035534] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.035616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.035839] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.035949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.036018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.036174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.036265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.036465] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.036557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.036608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.036747] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.036821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.036906] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 771.092518] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.092771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.092885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.093168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.093389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.111703] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 771.198998] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-696f1a6f-e565-4407-8024-9b5232f89615 tempest-ServersTestMultiNic-870967946 tempest-ServersTestMultiNic-870967946-project-member] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 771.200947] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 771.202007] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.203353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.282953] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.283376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.283376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.283584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.283584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.283803] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.283964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.284039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.284164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.284245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.284330] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c already deleted. [ 771.284409] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.284572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.284714] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.284853] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.284972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.285038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.285164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.285244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.285355] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.565787] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-f41d907f-54da-476b-b42f-0e0526b37479 tempest-ServersTestMultiNic-870967946 tempest-ServersTestMultiNic-870967946-project-member] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 771.567552] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 771.568035] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.568349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.787299] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.787651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.787651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.787828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.787945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.788160] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.788259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.788314] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.788474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.788474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.788474] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c already deleted. [ 771.788800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.788889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.789053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.789207] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.789323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.789391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.789530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.789607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.789705] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.888294] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.888294] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.888294] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.888294] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.888695] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.889062] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.889333] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.889686] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.892602] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.892602] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.892602] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.892602] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.892602] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.892602] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.892602] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.892602] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.911100] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.911375] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 771.911375] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.913585] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.913585] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-16788150-9914-4cec-b290-2d372e73b323 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.913585] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-16788150-9914-4cec-b290-2d372e73b323" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.913585] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-16788150-9914-4cec-b290-2d372e73b323" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.913585] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-16788150-9914-4cec-b290-2d372e73b323" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.913585] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16788150-9914-4cec-b290-2d372e73b323',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.293765] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.293765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.293765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.294041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.294104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.294314] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.294445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.294516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.294680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.294762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.294858] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c already deleted. [ 772.294931] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.416876] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.417119] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.417247] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.417528] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.417677] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.417832] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 16788150-9914-4cec-b290-2d372e73b323 not found, creating... [ 772.418104] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.418263] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.418379] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.418599] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.418735] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.419040] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.419234] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.419482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.419695] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.419827] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.419965] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 16788150-9914-4cec-b290-2d372e73b323 is going to be created. [ 772.439728] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.439952] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.440092] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.440357] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.440581] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.440799] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-16788150-9914-4cec-b290-2d372e73b323" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.125121] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 773.125394] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.160339] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-4dad7329-8666-47af-adf3-62b3033539d8 service nova] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_rules [ 773.160339] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-4dad7329-8666-47af-adf3-62b3033539d8 service nova] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 773.160339] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-4dad7329-8666-47af-adf3-62b3033539d8 service nova] Enqueued Resource ID: 16788150-9914-4cec-b290-2d372e73b323 with Priority: HIGHEST for action port [ 773.160339] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_rules [ 773.160339] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 773.160339] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16788150-9914-4cec-b290-2d372e73b323 with Priority: HIGHEST for action port [ 773.160339] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.160339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.160339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.160339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.160339] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.160807] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.160807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.160807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.160937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.161072] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.161391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.161391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.161559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.161559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.161642] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.163542] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-16788150-9914-4cec-b290-2d372e73b323 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.163686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16788150-9914-4cec-b290-2d372e73b323" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.163775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16788150-9914-4cec-b290-2d372e73b323" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.163946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16788150-9914-4cec-b290-2d372e73b323" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.164031] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16788150-9914-4cec-b290-2d372e73b323',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.665824] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.670115] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.670115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.670115] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16788150-9914-4cec-b290-2d372e73b323 with status ACTIVE [ 773.670115] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.670115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.670115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.670115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.670115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.670115] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.670115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.670115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.670115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.670115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.670115] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.670732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.670732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.670732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.670732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.672600] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16788150-9914-4cec-b290-2d372e73b323 is going to be updated. [ 773.692200] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.693229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.693229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.693229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.693229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.693229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16788150-9914-4cec-b290-2d372e73b323" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.909026] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-906 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.909026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-906" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.909026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-906" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.909026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-906" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.909026] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.909026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.909026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.909956] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.910238] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.910559] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.912925] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.912925] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.912925] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.912925] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.912925] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.912925] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.939227] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.939428] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 773.939581] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.939759] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-906" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.940084] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-e1a46a10-7094-42e6-9349-ed846f172452 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.940251] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-e1a46a10-7094-42e6-9349-ed846f172452" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.940370] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-e1a46a10-7094-42e6-9349-ed846f172452" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.940687] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-e1a46a10-7094-42e6-9349-ed846f172452" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.941483] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a46a10-7094-42e6-9349-ed846f172452',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.168797] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.444086] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.444842] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.444842] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.444842] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.445012] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.445209] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port e1a46a10-7094-42e6-9349-ed846f172452 not found, creating... [ 774.445420] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.445579] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.445724] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.445966] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.446194] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.446925] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.447104] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.447225] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.447530] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.447673] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.447811] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: e1a46a10-7094-42e6-9349-ed846f172452 is going to be created. [ 774.467934] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.468198] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.468330] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.468599] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.468826] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.469062] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-e1a46a10-7094-42e6-9349-ed846f172452" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.671274] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.671489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.671573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.676222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.676222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.676222] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be created. [ 774.704073] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.704229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.705063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.705063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.705063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.718052] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: UNINITIALIZED for 2s [ 775.318995] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-34504485-847f-4cdb-a344-b2a208c833e4 service nova] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_rules [ 775.319330] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-34504485-847f-4cdb-a344-b2a208c833e4 service nova] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 775.319515] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-34504485-847f-4cdb-a344-b2a208c833e4 service nova] Enqueued Resource ID: e1a46a10-7094-42e6-9349-ed846f172452 with Priority: HIGHEST for action port [ 775.320783] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_rules [ 775.320944] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 775.321084] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1a46a10-7094-42e6-9349-ed846f172452 with Priority: HIGHEST for action port [ 775.321487] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.321554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.321805] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.321852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.322040] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1a46a10-7094-42e6-9349-ed846f172452 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.322154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1a46a10-7094-42e6-9349-ed846f172452" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.322245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1a46a10-7094-42e6-9349-ed846f172452" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.322473] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1a46a10-7094-42e6-9349-ed846f172452" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.322597] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a46a10-7094-42e6-9349-ed846f172452',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.604871] env[69647]: INFO networking_nsxv3.common.synchronization [req-2ee1e772-d727-4c99-ae24-1cdc8da5bcc6 req-609b57a0-3f60-4109-a9b8-f7709622ce10 tempest-AttachVolumeShelveTestJSON-989009573 tempest-AttachVolumeShelveTestJSON-989009573-project-member] Enqueued Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_members [ 775.606760] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_members [ 775.607122] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-63aea974-cdb8-4b5a-9001-4a1c99d2d349 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.607294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.607354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.607586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.607767] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.607850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.607899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.608060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.608152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.608253] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.825127] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1a46a10-7094-42e6-9349-ed846f172452 with status ACTIVE [ 775.825357] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.825496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.825557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.825778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.825870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.826061] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.826159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.826221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.826369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.826445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.826623] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.826715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.826776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.826914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.827561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.827681] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1a46a10-7094-42e6-9349-ed846f172452 is going to be updated. [ 775.846386] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.846571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.846650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.846872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.847014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.847196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1a46a10-7094-42e6-9349-ed846f172452" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.112818] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.112818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.112818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.112818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.112818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.112818] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.112818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.112818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.112818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.112818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.112818] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 already deleted. [ 776.112818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.148156] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.148277] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.148420] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.148785] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.149073] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.149312] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.149520] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.149797] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.149996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.150563] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.150682] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.150889] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.151041] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.151371] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.151575] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.151729] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.169696] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.169853] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.169988] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.170214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.170537] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-46a71ed7-2cb5-4ada-a0df-94864c0679bf taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.170707] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.170824] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.172956] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.172956] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a71ed7-2cb5-4ada-a0df-94864c0679bf',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.565084] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.565084] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.565084] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.565084] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.565766] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.565766] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.565766] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.565766] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.566867] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.567107] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.567226] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.567478] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.567642] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.567758] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.567876] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.568010] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.585114] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.585281] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.585418] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.585591] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.585897] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-95b67e1e-36b4-4894-a255-73fb39505aa4 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.586075] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-95b67e1e-36b4-4894-a255-73fb39505aa4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.586192] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-95b67e1e-36b4-4894-a255-73fb39505aa4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.586855] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-95b67e1e-36b4-4894-a255-73fb39505aa4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.586855] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b67e1e-36b4-4894-a255-73fb39505aa4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.674320] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.674480] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.674620] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.674904] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.675188] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.675282] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 46a71ed7-2cb5-4ada-a0df-94864c0679bf not found, creating... [ 776.675466] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.675622] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.675738] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.675948] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.676225] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.676555] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.676716] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.676829] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.677045] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.677176] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.677313] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 46a71ed7-2cb5-4ada-a0df-94864c0679bf is going to be created. [ 776.696568] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.696568] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.696568] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.696826] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.696826] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.697040] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.733335] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 776.733335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.733335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.733495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.733687] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.733793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.733853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.734013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.734098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.734185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.734282] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.735784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.735891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.739022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.739022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.739022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.739022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.739022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.739022] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.095276] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.095276] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.095276] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.095276] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.095276] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.095811] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 95b67e1e-36b4-4894-a255-73fb39505aa4 not found, creating... [ 777.095811] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.095811] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.095996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.096199] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.096340] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.096786] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.096786] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.096938] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.097266] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.097266] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.097388] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 95b67e1e-36b4-4894-a255-73fb39505aa4 is going to be created. [ 777.116619] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.116861] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.117008] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.117290] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.117518] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.117744] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-95b67e1e-36b4-4894-a255-73fb39505aa4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.242206] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.242384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.244254] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.413982] env[69647]: INFO networking_nsxv3.common.synchronization [None req-efd77d5c-2138-43f1-a71b-50f80905f592 None None] Enqueued Resource ID: b07f91f8-eed1-4d93-9635-57404bf17588 with Priority: HIGHEST for action port [ 777.415580] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07f91f8-eed1-4d93-9635-57404bf17588 with Priority: HIGHEST for action port [ 777.415916] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b07f91f8-eed1-4d93-9635-57404bf17588 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.416074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b07f91f8-eed1-4d93-9635-57404bf17588" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.416154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b07f91f8-eed1-4d93-9635-57404bf17588" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.416424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b07f91f8-eed1-4d93-9635-57404bf17588" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.416510] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b07f91f8-eed1-4d93-9635-57404bf17588',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.607054] env[69647]: INFO networking_nsxv3.common.synchronization [req-2ee1e772-d727-4c99-ae24-1cdc8da5bcc6 req-9eee42cb-595d-4889-82c4-e9a5c5ee0ad1 service nova] Enqueued Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_rules [ 777.607374] env[69647]: INFO networking_nsxv3.common.synchronization [req-2ee1e772-d727-4c99-ae24-1cdc8da5bcc6 req-9eee42cb-595d-4889-82c4-e9a5c5ee0ad1 service nova] Enqueued Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_members [ 777.607374] env[69647]: INFO networking_nsxv3.common.synchronization [req-2ee1e772-d727-4c99-ae24-1cdc8da5bcc6 req-9eee42cb-595d-4889-82c4-e9a5c5ee0ad1 service nova] Enqueued Resource ID: 46a71ed7-2cb5-4ada-a0df-94864c0679bf with Priority: HIGHEST for action port [ 777.607600] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_rules [ 777.607795] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_members [ 777.607980] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a71ed7-2cb5-4ada-a0df-94864c0679bf with Priority: HIGHEST for action port [ 777.608494] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.608620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.608690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.608884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.608960] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.610490] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-63aea974-cdb8-4b5a-9001-4a1c99d2d349 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.610610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.610678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.610878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.611041] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.611176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.611236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.611383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.611490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.611586] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.612424] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-46a71ed7-2cb5-4ada-a0df-94864c0679bf taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.612526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.612618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.612739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.612822] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a71ed7-2cb5-4ada-a0df-94864c0679bf',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.745491] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.923038] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b07f91f8-eed1-4d93-9635-57404bf17588 [ 777.923038] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.923038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.923038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.923881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.924442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.924442] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b07f91f8-eed1-4d93-9635-57404bf17588 already deleted. [ 777.924442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b07f91f8-eed1-4d93-9635-57404bf17588" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.115102] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-63aea974-cdb8-4b5a-9001-4a1c99d2d349 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.115236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.115422] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.116421] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46a71ed7-2cb5-4ada-a0df-94864c0679bf with status ACTIVE [ 778.116608] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.116715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.116784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.116983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.117113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.117314] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.117469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.117562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.117728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.117809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.117988] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.118094] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.118157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.118298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.118372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.118456] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46a71ed7-2cb5-4ada-a0df-94864c0679bf is going to be updated. [ 778.138609] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.138777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.138851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.139244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.139451] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.139628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.160261] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-df5e299b-4262-4c73-9aad-9a31c7b68a7d service nova] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_rules [ 778.160530] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-df5e299b-4262-4c73-9aad-9a31c7b68a7d service nova] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 778.160742] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f0fd880-b8f4-4ee6-b62e-b168abbe26ba req-df5e299b-4262-4c73-9aad-9a31c7b68a7d service nova] Enqueued Resource ID: 95b67e1e-36b4-4894-a255-73fb39505aa4 with Priority: HIGHEST for action port [ 778.160975] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_rules [ 778.161149] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 778.161304] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95b67e1e-36b4-4894-a255-73fb39505aa4 with Priority: HIGHEST for action port [ 778.161834] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.161938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.164246] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.164369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.164557] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-95b67e1e-36b4-4894-a255-73fb39505aa4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.164684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95b67e1e-36b4-4894-a255-73fb39505aa4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.164787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95b67e1e-36b4-4894-a255-73fb39505aa4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.164909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95b67e1e-36b4-4894-a255-73fb39505aa4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.164994] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95b67e1e-36b4-4894-a255-73fb39505aa4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.247308] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.247494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.247571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.247967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.247967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.248079] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be updated. [ 778.278420] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.280102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.280203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.280963] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.281173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.295458] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 778.623300] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.671681] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95b67e1e-36b4-4894-a255-73fb39505aa4 with status ACTIVE [ 778.672054] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.672289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.672388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.672636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.672878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.673118] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.673313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.673411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.673643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.674112] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.674422] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.674587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.677344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.678038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.678136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.678232] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95b67e1e-36b4-4894-a255-73fb39505aa4 is going to be updated. [ 778.766944] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.767103] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.767178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.770997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.770997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.770997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95b67e1e-36b4-4894-a255-73fb39505aa4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.125995] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.126202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.126263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.126457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.126548] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.126644] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 is going to be created. [ 779.147554] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.147711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.147774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.147975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.148151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.157288] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 in Status: UNINITIALIZED for 2s [ 779.769580] env[69647]: INFO networking_nsxv3.common.synchronization [None req-e7ec22a4-3c4e-44cb-9352-90755dc74e0d None None] Enqueued Resource ID: 8cf8b285-2f5c-4147-bb26-627fef8fe68e with Priority: HIGHEST for action port [ 779.770104] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cf8b285-2f5c-4147-bb26-627fef8fe68e with Priority: HIGHEST for action port [ 779.770408] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cf8b285-2f5c-4147-bb26-627fef8fe68e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.770534] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cf8b285-2f5c-4147-bb26-627fef8fe68e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.770603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cf8b285-2f5c-4147-bb26-627fef8fe68e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.772865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cf8b285-2f5c-4147-bb26-627fef8fe68e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.772965] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cf8b285-2f5c-4147-bb26-627fef8fe68e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.277701] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cf8b285-2f5c-4147-bb26-627fef8fe68e [ 780.278070] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.278241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.278353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.278590] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.278695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.278801] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cf8b285-2f5c-4147-bb26-627fef8fe68e already deleted. [ 780.278918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cf8b285-2f5c-4147-bb26-627fef8fe68e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.305769] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 780.305769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.306017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.306345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.306951] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.306951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.306951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.307268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.308030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.308030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.308030] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.308030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.308269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.308507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.308546] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.308688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.308816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.309076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.309273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.309403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.310045] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.310761] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.312030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.312030] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.312030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.312030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.312030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.312030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.312030] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.814008] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c427a432-7eaa-43a9-b426-56f256eb360c: rpc.has_security_group_logging(os_id): False [ 780.816924] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.831562] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.831562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.831562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.831562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.831562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.831852] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.831852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.831852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.832175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.832175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.832557] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.832557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.832557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.832718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.832718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.832859] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.833083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.833083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.833316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.833395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.833497] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be created. [ 780.885312] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.885517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.885517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.885682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.885858] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.896310] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 781.167075] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 in Status: SUCCESS [ 781.167299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.167506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.167727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.167943] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.168047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.168106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.168256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.168337] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.168423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.168546] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.319395] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.672318] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.820831] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.821226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.821226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.822929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.826121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.826121] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be updated. [ 781.848353] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.848477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.848520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.848814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.850463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.857913] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 782.177969] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63aea974-cdb8-4b5a-9001-4a1c99d2d349: rpc.has_security_group_logging(os_id): False [ 782.205069] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.205291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.205376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.205520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.205610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.205863] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.205966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.206044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.206200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.206277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.206358] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 is going to be created. [ 782.279329] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.279584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.279638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.279806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.280061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.301022] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 in Status: IN_PROGRESS for 2s [ 782.908480] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 782.908781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.908882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.909119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.909207] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.185016] env[69647]: INFO networking_nsxv3.common.synchronization [req-d264efe0-1daf-44c8-a9b8-251118cf89a1 req-43a3cbbe-2857-49a7-9bfb-754842f4e340 tempest-ListImageFiltersTestJSON-89573635 tempest-ListImageFiltersTestJSON-89573635-project-member] Enqueued Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 783.185541] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 783.185835] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.185960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.186030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.186234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.186385] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.186480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.186542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.186673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.186750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.186845] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.416229] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.416401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.691235] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.869243] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 783.869496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.869670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.869897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.870109] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.870237] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.870297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.870925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.871036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.871140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.871239] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.194083] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.310788] env[69647]: INFO networking_nsxv3.common.synchronization [None req-97ddc480-cdc0-43d9-832d-a52d097fb5e7 None None] Enqueued Resource ID: 13dd574f-68d3-482e-80bf-9edf6340486c with Priority: HIGHEST for action port [ 784.312467] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 in Status: SUCCESS [ 784.312790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.313529] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13dd574f-68d3-482e-80bf-9edf6340486c with Priority: HIGHEST for action port [ 784.314030] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-13dd574f-68d3-482e-80bf-9edf6340486c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.315843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13dd574f-68d3-482e-80bf-9edf6340486c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.315843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13dd574f-68d3-482e-80bf-9edf6340486c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.315843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13dd574f-68d3-482e-80bf-9edf6340486c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.315843] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13dd574f-68d3-482e-80bf-9edf6340486c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.373217] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.373386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.373468] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.373662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.374052] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.374052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.374052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.374263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.374263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.374348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.374486] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.374577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.374631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.374769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.374901] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.374991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.375162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.375214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.375289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.375371] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.375458] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.696868] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.697385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.701038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.701038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.701038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.701038] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a is going to be updated. [ 784.725043] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.725195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.725236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.725475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.725599] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.735578] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: IN_PROGRESS for 2s [ 784.816646] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13dd574f-68d3-482e-80bf-9edf6340486c [ 784.816883] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.817036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.817107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.817321] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.817407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.817506] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13dd574f-68d3-482e-80bf-9edf6340486c already deleted. [ 784.817586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13dd574f-68d3-482e-80bf-9edf6340486c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.879602] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c427a432-7eaa-43a9-b426-56f256eb360c: rpc.has_security_group_logging(os_id): False [ 784.899039] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.899039] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.899039] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.899039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.899696] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.899696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.899696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.899696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.899696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.899696] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be updated. [ 784.956369] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.956511] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.956586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.957346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.957346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.970288] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 786.495577] env[69647]: INFO networking_nsxv3.common.synchronization [None req-882ae5fb-10fb-4711-91b1-f04db01be285 None None] Enqueued Resource ID: b18e609f-9ecd-4cba-afa0-f0a1803fda13 with Priority: HIGHEST for action port [ 786.496317] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b18e609f-9ecd-4cba-afa0-f0a1803fda13 with Priority: HIGHEST for action port [ 786.496631] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b18e609f-9ecd-4cba-afa0-f0a1803fda13 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.496631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b18e609f-9ecd-4cba-afa0-f0a1803fda13" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.496783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b18e609f-9ecd-4cba-afa0-f0a1803fda13" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.497863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b18e609f-9ecd-4cba-afa0-f0a1803fda13" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.497863] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b18e609f-9ecd-4cba-afa0-f0a1803fda13',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.612284] env[69647]: INFO networking_nsxv3.common.synchronization [req-958e7ce5-3a3a-4c96-ad64-8917f5d94499 req-c8eda3c4-3427-4179-bf17-2eeffcf48dd6 tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 786.613169] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 786.613267] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.613344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.613389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.613634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.614164] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.614164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.614164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.614164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.614164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.614507] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.750567] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: SUCCESS [ 786.750818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.982555] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 786.982783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.982988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.983244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.983339] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.003766] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b18e609f-9ecd-4cba-afa0-f0a1803fda13 [ 787.003766] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.003766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.003766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.003766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.003766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.003766] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b18e609f-9ecd-4cba-afa0-f0a1803fda13 already deleted. [ 787.003766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b18e609f-9ecd-4cba-afa0-f0a1803fda13" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.119384] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.119384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.119384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.119384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.119384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.119384] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.119384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.119384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.119384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.119384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.119384] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 already deleted. [ 787.119384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.151714] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.151843] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.152384] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.152384] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.152636] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.152817] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.152946] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.153202] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.153342] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.153571] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.153704] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.153820] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.153990] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.154046] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.154148] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.154295] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.196356] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.196676] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 787.196845] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.197104] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.197655] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-3bdaaa08-b6c2-47c0-ac48-de381b758f86 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.197907] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-3bdaaa08-b6c2-47c0-ac48-de381b758f86" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.198106] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-3bdaaa08-b6c2-47c0-ac48-de381b758f86" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.198544] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-3bdaaa08-b6c2-47c0-ac48-de381b758f86" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.198832] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bdaaa08-b6c2-47c0-ac48-de381b758f86',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.488128] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.488128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.488128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.488128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.488128] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.488128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.488128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.488128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.488128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.488128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.488128] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.701723] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.702075] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.702075] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.702404] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.702564] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.702720] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 3bdaaa08-b6c2-47c0-ac48-de381b758f86 not found, creating... [ 787.702989] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.703195] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.703346] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.703530] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.703706] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.704016] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.704411] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.704535] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.704770] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.704909] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.705076] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 3bdaaa08-b6c2-47c0-ac48-de381b758f86 is going to be created. [ 787.726159] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.726159] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.726419] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.726519] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.726736] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.726958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-3bdaaa08-b6c2-47c0-ac48-de381b758f86" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.990412] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.990683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.990825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.991027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.991266] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.991451] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.992055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.992055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.992055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.992055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.992615] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.992615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.992615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.992615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.992615] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.992920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.992920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.992920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.993041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.993146] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.993277] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.495780] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c427a432-7eaa-43a9-b426-56f256eb360c: rpc.has_security_group_logging(os_id): False [ 788.513516] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.513691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.513785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.514010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.514124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.514356] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.514461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.514524] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.514678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.514753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.514924] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.515028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.515089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.515226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.515299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.515488] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.515569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.515632] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.515765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.515836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.515941] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be updated. [ 788.566859] env[69647]: INFO networking_nsxv3.common.synchronization [req-958e7ce5-3a3a-4c96-ad64-8917f5d94499 req-a736d0fa-dd56-4868-b654-5e98904a41eb service nova] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_rules [ 788.567061] env[69647]: INFO networking_nsxv3.common.synchronization [req-958e7ce5-3a3a-4c96-ad64-8917f5d94499 req-a736d0fa-dd56-4868-b654-5e98904a41eb service nova] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 788.567203] env[69647]: INFO networking_nsxv3.common.synchronization [req-958e7ce5-3a3a-4c96-ad64-8917f5d94499 req-a736d0fa-dd56-4868-b654-5e98904a41eb service nova] Enqueued Resource ID: 3bdaaa08-b6c2-47c0-ac48-de381b758f86 with Priority: HIGHEST for action port [ 788.567741] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_rules [ 788.567878] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 788.567977] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bdaaa08-b6c2-47c0-ac48-de381b758f86 with Priority: HIGHEST for action port [ 788.568396] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.568396] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.568518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.568668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.568750] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.569626] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.569740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.569807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.569972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.570132] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.570686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.570773] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.570935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.571037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.571133] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.572384] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bdaaa08-b6c2-47c0-ac48-de381b758f86 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.572502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bdaaa08-b6c2-47c0-ac48-de381b758f86" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.572549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bdaaa08-b6c2-47c0-ac48-de381b758f86" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.573142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bdaaa08-b6c2-47c0-ac48-de381b758f86" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.573232] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bdaaa08-b6c2-47c0-ac48-de381b758f86',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.579423] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.579423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.579423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.579423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.579423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.593098] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 789.077819] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.078858] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.078988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.082550] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bdaaa08-b6c2-47c0-ac48-de381b758f86 with status ACTIVE [ 789.082718] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.082838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.082904] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.083159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.083212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.083384] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.083491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.083539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.083688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.083761] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.083937] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.084117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.084177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.084323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.084762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.084834] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bdaaa08-b6c2-47c0-ac48-de381b758f86 is going to be updated. [ 789.104571] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.104698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.104770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.104961] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.105118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.105357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bdaaa08-b6c2-47c0-ac48-de381b758f86" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.392252] env[69647]: INFO networking_nsxv3.common.synchronization [req-23d091b8-0f15-4671-b775-fd16b8394bcd req-98bec49e-ff2a-4074-a965-0b7c859e2dbb tempest-ServersTestMultiNic-870967946 tempest-ServersTestMultiNic-870967946-project-member] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 789.392812] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 789.393120] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.393244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.393313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.393510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.393660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.393756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.393818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.393960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.394122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.394226] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.580881] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.656936] env[69647]: INFO networking_nsxv3.common.synchronization [req-23d091b8-0f15-4671-b775-fd16b8394bcd req-197f72f2-5f0f-4ae3-878c-880fc9162bb0 tempest-ServersTestMultiNic-870967946 tempest-ServersTestMultiNic-870967946-project-member] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 789.657560] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 789.657862] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.657959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.898264] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.086352] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.090310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.090310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.090310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.090310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.090310] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be created. [ 790.114389] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.114765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.114935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.115231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.115591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.123315] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: UNINITIALIZED for 2s [ 790.280677] env[69647]: INFO networking_nsxv3.common.synchronization [req-23d091b8-0f15-4671-b775-fd16b8394bcd req-af0eb8d4-8569-484c-8e62-5bec073800d7 tempest-ServersTestMultiNic-870967946 tempest-ServersTestMultiNic-870967946-project-member] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 790.281356] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 790.281650] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.281746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.400167] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.609157] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 790.609932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.902816] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.902939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.902991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.903244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.903327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.903432] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be updated. [ 790.930389] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.930584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.930584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.930811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.930959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.942965] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 791.566820] env[69647]: INFO networking_nsxv3.common.synchronization [req-7e7d5ea6-ca25-4664-a11d-d75f90da8681 req-4c7f6124-afd4-4640-b403-d9fd1ad394aa tempest-InstanceActionsV221TestJSON-608524339 tempest-InstanceActionsV221TestJSON-608524339-project-member] Enqueued Resource ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 with Priority: HIGHEST for action security_group_members [ 791.567470] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 with Priority: HIGHEST for action security_group_members [ 791.568149] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.568303] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.568386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.568872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.568872] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.568872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.569038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.569073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.569172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.569260] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.859182] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.859425] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.859553] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.860682] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.861021] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.861192] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.861304] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.861562] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.861693] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.861901] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.862015] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.862130] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.862234] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.862357] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.862496] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.862635] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.883153] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.883322] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 791.883458] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.883633] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.884379] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-708d5578-b75a-4e80-8334-5fc3da985ccf taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.884379] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-708d5578-b75a-4e80-8334-5fc3da985ccf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.884379] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-708d5578-b75a-4e80-8334-5fc3da985ccf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.884625] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-708d5578-b75a-4e80-8334-5fc3da985ccf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.884700] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('708d5578-b75a-4e80-8334-5fc3da985ccf',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.073036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.073036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.073036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.073036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.073036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.073036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.073036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.073036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.073610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.073610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.073610] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 already deleted. [ 792.073610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.134419] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: UNINITIALIZED for 4s [ 792.387671] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.388430] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.388430] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.388430] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.388609] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.388729] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 708d5578-b75a-4e80-8334-5fc3da985ccf not found, creating... [ 792.388896] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.389063] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.389179] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.389568] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.389661] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.389899] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.390074] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.390254] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.390398] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.390587] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.391071] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 708d5578-b75a-4e80-8334-5fc3da985ccf is going to be created. [ 792.410998] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.411111] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.411934] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.411934] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.411934] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.412435] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-708d5578-b75a-4e80-8334-5fc3da985ccf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.954137] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 792.954447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.954490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.955529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.955529] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.955529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.955529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.955529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.955529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.955529] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.156334] env[69647]: INFO networking_nsxv3.common.synchronization [req-7e7d5ea6-ca25-4664-a11d-d75f90da8681 req-cf527385-8461-4650-b964-7450a1af1e7d service nova] Enqueued Resource ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 with Priority: HIGHEST for action security_group_rules [ 793.156334] env[69647]: INFO networking_nsxv3.common.synchronization [req-7e7d5ea6-ca25-4664-a11d-d75f90da8681 req-cf527385-8461-4650-b964-7450a1af1e7d service nova] Enqueued Resource ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 with Priority: HIGHEST for action security_group_members [ 793.156334] env[69647]: INFO networking_nsxv3.common.synchronization [req-7e7d5ea6-ca25-4664-a11d-d75f90da8681 req-cf527385-8461-4650-b964-7450a1af1e7d service nova] Enqueued Resource ID: 708d5578-b75a-4e80-8334-5fc3da985ccf with Priority: HIGHEST for action port [ 793.156334] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 with Priority: HIGHEST for action security_group_rules [ 793.158614] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 with Priority: HIGHEST for action security_group_members [ 793.161526] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 708d5578-b75a-4e80-8334-5fc3da985ccf with Priority: HIGHEST for action port [ 793.162027] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.162158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.162225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.162523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.162588] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.164256] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.164256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.164256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.164256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.164451] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.164496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.164631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.164693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.166027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.166027] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.166027] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-708d5578-b75a-4e80-8334-5fc3da985ccf taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.166027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-708d5578-b75a-4e80-8334-5fc3da985ccf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.166027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-708d5578-b75a-4e80-8334-5fc3da985ccf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.166027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-708d5578-b75a-4e80-8334-5fc3da985ccf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.166027] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('708d5578-b75a-4e80-8334-5fc3da985ccf',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.461566] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.461566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.461566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.461566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.461566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.461566] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.461566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.461566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.461566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.461566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.461566] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be updated. [ 793.486826] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.486826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.486826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.486826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.486826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.495663] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 793.503722] env[69647]: INFO networking_nsxv3.common.synchronization [req-abaf4df8-92b3-4240-918d-748206ef3dbc req-0a103bfa-45f5-46f4-8e1b-b7b6b9d7914f tempest-ServersTestManualDisk-61462443 tempest-ServersTestManualDisk-61462443-project-member] Enqueued Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_members [ 793.504921] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGHEST for action security_group_members [ 793.504921] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-627fe875-c21d-4d02-9ec5-0f012cb64fc1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.504921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.504921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.505309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.505451] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.505614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.505699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.505903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.506022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.506130] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('627fe875-c21d-4d02-9ec5-0f012cb64fc1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.667941] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.671194] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.671366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.672172] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 708d5578-b75a-4e80-8334-5fc3da985ccf with status ACTIVE [ 793.672172] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.672172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.672172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.672172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.672172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.672598] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.672598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.672598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.672598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.672752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.672807] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.672893] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.672954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.673319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.673319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.673438] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 708d5578-b75a-4e80-8334-5fc3da985ccf is going to be updated. [ 793.692519] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.692726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.692784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.692941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.693088] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.693241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-708d5578-b75a-4e80-8334-5fc3da985ccf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.008522] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.008844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.008844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.009088] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.009088] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.009864] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.009864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.009864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.009864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.009864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.009864] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 is going to be updated. [ 794.033639] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.033776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.033845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.034040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.034182] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.041408] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 in Status: IN_PROGRESS for 2s [ 794.144159] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: SUCCESS [ 794.144392] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.144548] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.144791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.145094] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.145192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.145192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.145354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.145435] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.145533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.145629] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.160389] env[69647]: INFO networking_nsxv3.common.synchronization [req-f336cd7d-6ea0-450d-8efe-5734d4820ea6 req-ef421317-8d55-44a8-8895-f50c6117e162 tempest-ServerActionsV293TestJSON-654612076 tempest-ServerActionsV293TestJSON-654612076-project-member] Enqueued Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_members [ 794.161050] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_members [ 794.161376] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d92e25ad-3d95-4a6f-bb9e-55be52df486a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.161589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.161589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.161808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.161935] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.162053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.162118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.162289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.162384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.162486] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.176112] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.648133] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.665454] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.665617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.665693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.665908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.665999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.666243] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.666426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.666463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.666606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.666686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.666775] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a already deleted. [ 794.666856] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.682726] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.682870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.682954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.683194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.683300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.683399] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 is going to be created. [ 794.705435] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.705629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.705674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.705870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.706041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.716989] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 in Status: UNINITIALIZED for 2s [ 794.734214] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-426 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.734214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-426" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.734214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-426" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.734214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-426" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.734214] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.734214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.734214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.734214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.734214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.734640] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.734640] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.734640] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.734802] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.735078] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.735252] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.735426] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.753564] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.753730] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.753866] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.754068] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-426" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.754387] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-3e5e9f71-7f87-4694-b415-5b092c8c01b1 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.754563] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-3e5e9f71-7f87-4694-b415-5b092c8c01b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.754676] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-3e5e9f71-7f87-4694-b415-5b092c8c01b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.754992] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-3e5e9f71-7f87-4694-b415-5b092c8c01b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.755137] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e5e9f71-7f87-4694-b415-5b092c8c01b1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.152694] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efccc372-9e22-4eea-9577-4fd80da780f3: rpc.has_security_group_logging(os_id): False [ 795.175382] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.175382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.175382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.175382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.175382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.175382] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.175382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.175382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.175382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.175382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.175382] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be created. [ 795.238026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.238026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.238026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.238026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.238026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.255644] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: IN_PROGRESS for 2s [ 795.258014] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.258014] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.258014] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.258014] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.258014] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.258246] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 3e5e9f71-7f87-4694-b415-5b092c8c01b1 not found, creating... [ 795.258399] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.258549] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.258663] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.258874] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.259012] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.260025] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.260025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.260025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.260025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.260025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.260291] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 3e5e9f71-7f87-4694-b415-5b092c8c01b1 is going to be created. [ 795.279593] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.279787] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.279911] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.280186] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.280405] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.280624] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-3e5e9f71-7f87-4694-b415-5b092c8c01b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.505163] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 795.505346] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c deletion is rescheduled due to dependency. [ 795.505467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.505631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.505850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.506039] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.506157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.506223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.506398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.506487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.506584] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.009927] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.010084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.010157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.010395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.010792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.010792] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.010958] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.010958] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.011207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.011207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.011302] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be updated. [ 796.036263] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.036263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.036409] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.036483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.036627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.044778] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 796.052978] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 in Status: SUCCESS [ 796.053606] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 deletion is rescheduled due to dependency. [ 796.053606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.096832] env[69647]: INFO networking_nsxv3.common.synchronization [None req-c6f438df-26a5-4ded-af8a-fd4493dbc3d2 None None] Enqueued Resource ID: 54b39200-511e-47c6-8b6f-d0d33589e3c4 with Priority: HIGHEST for action port [ 796.097200] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b39200-511e-47c6-8b6f-d0d33589e3c4 with Priority: HIGHEST for action port [ 796.097812] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-54b39200-511e-47c6-8b6f-d0d33589e3c4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.097967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54b39200-511e-47c6-8b6f-d0d33589e3c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.098061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54b39200-511e-47c6-8b6f-d0d33589e3c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.098361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54b39200-511e-47c6-8b6f-d0d33589e3c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.098456] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54b39200-511e-47c6-8b6f-d0d33589e3c4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.245149] env[69647]: INFO networking_nsxv3.common.synchronization [req-f336cd7d-6ea0-450d-8efe-5734d4820ea6 req-6f35ea58-6e76-4b58-bffd-5d01f0b07a3d service nova] Enqueued Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_rules [ 796.245149] env[69647]: INFO networking_nsxv3.common.synchronization [req-f336cd7d-6ea0-450d-8efe-5734d4820ea6 req-6f35ea58-6e76-4b58-bffd-5d01f0b07a3d service nova] Enqueued Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_members [ 796.245149] env[69647]: INFO networking_nsxv3.common.synchronization [req-f336cd7d-6ea0-450d-8efe-5734d4820ea6 req-6f35ea58-6e76-4b58-bffd-5d01f0b07a3d service nova] Enqueued Resource ID: 3e5e9f71-7f87-4694-b415-5b092c8c01b1 with Priority: HIGHEST for action port [ 796.245149] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_rules [ 796.245149] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_members [ 796.245149] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e5e9f71-7f87-4694-b415-5b092c8c01b1 with Priority: HIGHEST for action port [ 796.245149] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.245149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.246306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.246668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.246899] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.248538] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d92e25ad-3d95-4a6f-bb9e-55be52df486a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.248820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.249023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.249351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.250702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.250702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.250702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.250702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.250702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.250702] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.254889] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e5e9f71-7f87-4694-b415-5b092c8c01b1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.254889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e5e9f71-7f87-4694-b415-5b092c8c01b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.254889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e5e9f71-7f87-4694-b415-5b092c8c01b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.254889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e5e9f71-7f87-4694-b415-5b092c8c01b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.254889] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e5e9f71-7f87-4694-b415-5b092c8c01b1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.600971] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54b39200-511e-47c6-8b6f-d0d33589e3c4 [ 796.601383] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.602804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.603354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.603664] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.603847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.603987] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54b39200-511e-47c6-8b6f-d0d33589e3c4 already deleted. [ 796.604385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54b39200-511e-47c6-8b6f-d0d33589e3c4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.728992] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 in Status: SUCCESS [ 796.731901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.731901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.731901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.731901] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.731901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.731901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.731901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.731901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.731901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.731901] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.750075] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d92e25ad-3d95-4a6f-bb9e-55be52df486a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.750216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.756028] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.760088] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e5e9f71-7f87-4694-b415-5b092c8c01b1 with status ACTIVE [ 796.760313] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.760719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.760719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.760719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.760864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.761076] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.761076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.761185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.761272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.761318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.761530] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.761623] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.761711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.761845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.761914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.761996] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e5e9f71-7f87-4694-b415-5b092c8c01b1 is going to be updated. [ 796.784270] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.784423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.784557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.784813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.784981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.785756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e5e9f71-7f87-4694-b415-5b092c8c01b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.235599] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.235786] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.235880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.236154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.236351] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.236472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.236556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.237342] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.237342] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.237342] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.237342] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.237342] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.237342] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.237685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.237685] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.238238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.238238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.238238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.238238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.238238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.238760] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.261087] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.272272] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: SUCCESS [ 797.272272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.398809] env[69647]: INFO networking_nsxv3.common.synchronization [req-ee795353-86ce-46a5-90a7-f888271311b3 req-ce66216f-5885-4790-a751-d29d837a2a2a tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 797.400601] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 797.401220] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.401360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.401470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.401750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.401916] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.402052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.402136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.402390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.402463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.402616] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.740998] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45: rpc.has_security_group_logging(os_id): False [ 797.761139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.761139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.761139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.761139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.761861] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.761861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.761861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.761861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.761861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.761861] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 is going to be created. [ 797.769405] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.769574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.769614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.769771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.769852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.769940] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a is going to be created. [ 797.789066] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.789178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.789222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.789433] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.789592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.798864] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a in Status: UNINITIALIZED for 2s [ 797.818394] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.818575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.818656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.818890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.819108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.829895] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 in Status: IN_PROGRESS for 2s [ 797.906395] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.906544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.906612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.906845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.906946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.907160] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.907257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.907317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.907483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.907554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.907637] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 already deleted. [ 797.907711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.024586] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-531 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.024792] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-531" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.024919] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-531" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.025264] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-531" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.025544] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.025723] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.025841] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.026082] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.026231] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.026591] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.026721] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.026833] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.026943] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.027126] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.027252] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.027388] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.045867] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.045867] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.045867] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.045867] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-531" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.046474] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.046474] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.046474] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.046845] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.046998] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74fbb09f-844c-4cd9-a88b-d5485a8d89c8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.068516] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 798.069266] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c deletion is rescheduled due to dependency. [ 798.069266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.550229] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.550555] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.550598] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.550877] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.551141] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.551234] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 not found, creating... [ 798.551530] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.551735] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.551735] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.551964] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.552116] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.552784] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.552978] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.556298] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.556608] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.556769] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.556924] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 is going to be created. [ 798.578146] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.578354] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.578499] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.578815] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.579383] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.579672] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.632581] env[69647]: INFO networking_nsxv3.common.synchronization [None req-b05e3bea-a0df-478b-ab9f-e1fe4ba76ad8 None None] Enqueued Resource ID: bc7fbaf8-fd9d-49ba-8306-c1afe652b1d1 with Priority: HIGHEST for action port [ 798.632806] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7fbaf8-fd9d-49ba-8306-c1afe652b1d1 with Priority: HIGHEST for action port [ 798.633848] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc7fbaf8-fd9d-49ba-8306-c1afe652b1d1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.633848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc7fbaf8-fd9d-49ba-8306-c1afe652b1d1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.633848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc7fbaf8-fd9d-49ba-8306-c1afe652b1d1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.633848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc7fbaf8-fd9d-49ba-8306-c1afe652b1d1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.633848] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc7fbaf8-fd9d-49ba-8306-c1afe652b1d1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.135528] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc7fbaf8-fd9d-49ba-8306-c1afe652b1d1 [ 799.137262] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.137262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.137460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.138524] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.138524] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.138524] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc7fbaf8-fd9d-49ba-8306-c1afe652b1d1 already deleted. [ 799.138524] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc7fbaf8-fd9d-49ba-8306-c1afe652b1d1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.404427] env[69647]: INFO networking_nsxv3.common.synchronization [req-ee795353-86ce-46a5-90a7-f888271311b3 req-f60ec07a-5680-4357-833c-699c9d982849 service nova] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_rules [ 799.404427] env[69647]: INFO networking_nsxv3.common.synchronization [req-ee795353-86ce-46a5-90a7-f888271311b3 req-f60ec07a-5680-4357-833c-699c9d982849 service nova] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 799.404427] env[69647]: INFO networking_nsxv3.common.synchronization [req-ee795353-86ce-46a5-90a7-f888271311b3 req-f60ec07a-5680-4357-833c-699c9d982849 service nova] Enqueued Resource ID: 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 with Priority: HIGHEST for action port [ 799.404427] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_rules [ 799.404427] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 799.404427] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 with Priority: HIGHEST for action port [ 799.404427] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.407257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.407257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.407512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.407588] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.408564] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.408690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.408757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.408932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.409103] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.410520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.410520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.410520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.410520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.410520] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.410520] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.410520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.410520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.410932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.410932] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74fbb09f-844c-4cd9-a88b-d5485a8d89c8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.683131] env[69647]: INFO networking_nsxv3.common.synchronization [req-c1110fd3-bfbd-4de0-bcbb-8e4042811ea1 req-41b5eedc-87b7-4c7f-8607-5646b7349b21 tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_members [ 799.683598] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_members [ 799.683733] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.683858] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.683930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.684254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.684414] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.684521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.684582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.684739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.684821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.684955] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.811927] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a in Status: SUCCESS [ 799.811927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.811927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.811927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.811927] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.811927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.811927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.811927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.811927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.811927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.811927] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.841727] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 in Status: SUCCESS [ 799.841946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.913419] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.913628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.913918] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.915177] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 with status ACTIVE [ 799.915443] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.915606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.915698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.915972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.916155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.916535] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.916535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.916907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.916907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.916907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.917141] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.917270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.917355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.917564] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.917670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.917783] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 is going to be updated. [ 799.946211] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.946373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.951614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.951614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.951614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.951614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.999570] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-451 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.999767] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.999890] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.000284] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.000552] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.000707] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.000820] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.001044] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.001191] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.003040] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.003040] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 800.003040] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 800.003040] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 800.003040] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.003040] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 800.003040] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 800.023540] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 800.023540] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 800.023540] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 800.023725] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.023952] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-0572d318-bf3a-4eda-b7a0-5be1f09dc20c taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.024194] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-0572d318-bf3a-4eda-b7a0-5be1f09dc20c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.024319] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-0572d318-bf3a-4eda-b7a0-5be1f09dc20c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.024633] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-0572d318-bf3a-4eda-b7a0-5be1f09dc20c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.024775] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0572d318-bf3a-4eda-b7a0-5be1f09dc20c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.193774] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.193774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.193774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.193774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.193774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.193774] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.193774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.193774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.193774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.193774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.193774] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a already deleted. [ 800.193774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.315404] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.420144] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.529301] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.529301] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.529301] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.529301] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.529301] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.529301] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 0572d318-bf3a-4eda-b7a0-5be1f09dc20c not found, creating... [ 800.529754] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.529754] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.529754] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.530592] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.530592] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.530592] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.530592] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.530825] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.531662] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.531828] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.531982] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 0572d318-bf3a-4eda-b7a0-5be1f09dc20c is going to be created. [ 800.551567] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.551909] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.552066] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.552848] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.552848] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.552848] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-0572d318-bf3a-4eda-b7a0-5be1f09dc20c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.819078] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d92e25ad-3d95-4a6f-bb9e-55be52df486a: rpc.has_security_group_logging(os_id): False [ 800.839116] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.839320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.839423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.839680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.839783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.840060] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.840188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.840283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.840625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.840756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.840902] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a is going to be created. [ 800.907643] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.907643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.907643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.907643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.907643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.922592] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.922824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.922899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.923141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.923252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.923577] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 is going to be created. [ 800.929121] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a in Status: IN_PROGRESS for 2s [ 800.990421] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.990421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.990942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.991348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.991540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.017871] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: UNINITIALIZED for 2s [ 801.654258] env[69647]: INFO networking_nsxv3.common.synchronization [req-c1110fd3-bfbd-4de0-bcbb-8e4042811ea1 req-4766aa3f-4cc9-4e81-8eb0-53a9673f7750 service nova] Enqueued Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_rules [ 801.654258] env[69647]: INFO networking_nsxv3.common.synchronization [req-c1110fd3-bfbd-4de0-bcbb-8e4042811ea1 req-4766aa3f-4cc9-4e81-8eb0-53a9673f7750 service nova] Enqueued Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_members [ 801.654258] env[69647]: INFO networking_nsxv3.common.synchronization [req-c1110fd3-bfbd-4de0-bcbb-8e4042811ea1 req-4766aa3f-4cc9-4e81-8eb0-53a9673f7750 service nova] Enqueued Resource ID: 0572d318-bf3a-4eda-b7a0-5be1f09dc20c with Priority: HIGHEST for action port [ 801.654258] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_rules [ 801.654258] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_members [ 801.654258] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0572d318-bf3a-4eda-b7a0-5be1f09dc20c with Priority: HIGHEST for action port [ 801.655022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.655022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.655212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.655253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.655325] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.656238] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.657051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.657051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.657051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.657051] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.657051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.657051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.657051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.657457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.657457] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.658023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-0572d318-bf3a-4eda-b7a0-5be1f09dc20c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.658161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0572d318-bf3a-4eda-b7a0-5be1f09dc20c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.658249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0572d318-bf3a-4eda-b7a0-5be1f09dc20c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.658332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0572d318-bf3a-4eda-b7a0-5be1f09dc20c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.658407] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0572d318-bf3a-4eda-b7a0-5be1f09dc20c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.160772] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.166026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.166026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.166026] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0572d318-bf3a-4eda-b7a0-5be1f09dc20c with status ACTIVE [ 802.166026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.166026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.166026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.166026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.166026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.166026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.166026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.166026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.166026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.166026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.166026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.167335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.167335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.167335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.167335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.167335] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0572d318-bf3a-4eda-b7a0-5be1f09dc20c is going to be updated. [ 802.188648] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.188962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.188962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.189157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.189360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.189725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0572d318-bf3a-4eda-b7a0-5be1f09dc20c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.202942] env[69647]: INFO networking_nsxv3.common.synchronization [req-18eb49f5-351d-4ace-8156-47cace6ea6b6 req-02f81d71-11cc-46e5-8ff4-d3443166e87f tempest-AttachVolumeTestJSON-1527312667 tempest-AttachVolumeTestJSON-1527312667-project-member] Enqueued Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_members [ 802.202942] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_members [ 802.202942] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-80142545-bab7-4367-b0e0-40b8e04f4503 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.202942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.202942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.202942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.202942] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.202942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.202942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.202942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.202942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.202942] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.580343] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.580576] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-245" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.580660] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-245" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.581024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-245" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.581418] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.581730] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.581810] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.582030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.582759] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.582759] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.582759] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.582759] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.582759] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.583226] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.583226] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.583226] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.604964] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.605158] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 802.605305] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.605504] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-245" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.606244] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.606244] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.606244] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.606471] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.606611] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.663729] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.707647] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.707806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.707887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.708099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.708190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.708387] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.708494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.708554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.708703] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.711704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.711864] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80142545-bab7-4367-b0e0-40b8e04f4503 already deleted. [ 802.711968] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.939854] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a in Status: SUCCESS [ 802.940132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.026714] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: SUCCESS [ 803.026916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.027086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.027300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.027490] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.027637] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.027700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.027831] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.027913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.028022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.028120] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.111120] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.111239] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.111305] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.111662] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.111824] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.111979] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219 not found, creating... [ 803.112253] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.112420] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.112571] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.112838] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.113027] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.113315] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.113508] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.113637] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.113915] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.113963] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.114106] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219 is going to be created. [ 803.135692] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.139053] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.139053] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.139053] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.139053] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.139053] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.166657] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.167047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.167047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.167124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.167206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.167305] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a is going to be created. [ 803.193355] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.193523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.193581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.193793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.193944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.213707] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a in Status: UNINITIALIZED for 2s [ 803.532261] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.034548] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fe058e6-1ee1-46bc-bd88-8e66f89cb196: rpc.has_security_group_logging(os_id): False [ 804.052432] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.052432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.052432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.052432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.052432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.052432] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.052432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.052432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.055022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.055022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.055022] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 is going to be created. [ 804.110824] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.111224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.111749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.112077] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.112435] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.121293] env[69647]: INFO networking_nsxv3.common.synchronization [req-18eb49f5-351d-4ace-8156-47cace6ea6b6 req-2a2c30b4-9412-4827-ae4c-1ee994e9c30e service nova] Enqueued Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_rules [ 804.121293] env[69647]: INFO networking_nsxv3.common.synchronization [req-18eb49f5-351d-4ace-8156-47cace6ea6b6 req-2a2c30b4-9412-4827-ae4c-1ee994e9c30e service nova] Enqueued Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_members [ 804.121293] env[69647]: INFO networking_nsxv3.common.synchronization [req-18eb49f5-351d-4ace-8156-47cace6ea6b6 req-2a2c30b4-9412-4827-ae4c-1ee994e9c30e service nova] Enqueued Resource ID: bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219 with Priority: HIGHEST for action port [ 804.121293] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_rules [ 804.124065] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_members [ 804.124304] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219 with Priority: HIGHEST for action port [ 804.129361] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80142545-bab7-4367-b0e0-40b8e04f4503 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.129361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.129361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.129361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.129361] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.129361] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-80142545-bab7-4367-b0e0-40b8e04f4503 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.129361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.129361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.129361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.129361] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.129361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.129361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.129361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.129361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.129361] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.130859] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.130859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.130859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.130859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.130859] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.132947] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: IN_PROGRESS for 2s [ 804.634372] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-80142545-bab7-4367-b0e0-40b8e04f4503 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.634681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.634728] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.635618] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219 with status ACTIVE [ 804.635775] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.635897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.635986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.636241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.636360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.636574] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.636745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.636847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.640595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.640746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.641014] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.641132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.641201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.641365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.641469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.641564] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219 is going to be updated. [ 804.662296] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.662296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.662487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.662814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.662814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.662925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfe50c6c-91a9-4b84-8a8d-d24ddfb4b219" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.926608] env[69647]: INFO networking_nsxv3.common.synchronization [req-5c1c16c3-c580-4f5a-9054-3374128f373a req-5f9d278b-ce43-4813-9cc2-eed5d9b1a728 tempest-ImagesTestJSON-954996409 tempest-ImagesTestJSON-954996409-project-member] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 804.928278] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 804.928821] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.929020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.929139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.929495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.929741] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.929954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.930093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.930351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.930530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.930701] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.027753] env[69647]: INFO networking_nsxv3.common.synchronization [req-96c6e88d-f69d-4ed5-bb1c-d15c94c74582 req-bf07880b-4b6f-4303-8653-188055262aae tempest-InstanceActionsV221TestJSON-608524339 tempest-InstanceActionsV221TestJSON-608524339-project-member] Enqueued Resource ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 with Priority: HIGHEST for action security_group_members [ 805.031509] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 with Priority: HIGHEST for action security_group_members [ 805.031509] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.031509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.031509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.031509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.031509] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.031509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.031509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.031509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.031509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.031509] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.144141] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.230895] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a in Status: SUCCESS [ 805.230895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.230895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.230895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.230895] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.230895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.230895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.230895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.230895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.230895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.230895] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.427107] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-984 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.427107] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.427107] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.427107] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.427107] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.427107] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.427107] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.427596] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.427965] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.428388] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.428843] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.429335] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.429709] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.430168] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 805.430934] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.430934] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.433570] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.433766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.433882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.434128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.434274] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.434530] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.434737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.435884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.435884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.435884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.435884] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 805.454066] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.454407] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 805.454601] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.454784] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.455107] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-c40ffc34-cc7f-49f8-a373-276e80d34e6c taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.455280] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-c40ffc34-cc7f-49f8-a373-276e80d34e6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.455392] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-c40ffc34-cc7f-49f8-a373-276e80d34e6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.455749] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-c40ffc34-cc7f-49f8-a373-276e80d34e6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.456772] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c40ffc34-cc7f-49f8-a373-276e80d34e6c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.471278] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.471278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.471278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.471278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.471278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.482125] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 805.533431] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.533586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.533653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.534365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.534365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.534365] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.534365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.534662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.534662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.534762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.534997] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 is going to be updated. [ 805.568174] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.568600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.568686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.568997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.569420] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.583070] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 in Status: IN_PROGRESS for 2s [ 805.648180] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.650628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.650628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.650628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.650628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.650628] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80142545-bab7-4367-b0e0-40b8e04f4503 is going to be created. [ 805.675908] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.676400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.677400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.677400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.677400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.689716] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80142545-bab7-4367-b0e0-40b8e04f4503 in Status: UNINITIALIZED for 2s [ 805.734478] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.960216] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.960457] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.960584] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.960933] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.961036] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.961195] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port c40ffc34-cc7f-49f8-a373-276e80d34e6c not found, creating... [ 805.961485] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.961662] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.961782] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.962010] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.962164] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.962454] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.962607] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.962723] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.962929] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.963073] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.963214] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: c40ffc34-cc7f-49f8-a373-276e80d34e6c is going to be created. [ 805.993138] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.993449] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.993510] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.994453] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.994642] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.994908] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-c40ffc34-cc7f-49f8-a373-276e80d34e6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.149038] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: SUCCESS [ 806.149168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.238485] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bf79df0-b6e9-4d9d-a118-0af87f6e322a: rpc.has_security_group_logging(os_id): False [ 806.267074] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.267074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.267074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.267074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.267074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.267074] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.267074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.267388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.267388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.267440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.273027] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a is going to be created. [ 806.337549] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.337745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.337999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.338067] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.338266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.352146] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a in Status: IN_PROGRESS for 2s [ 806.560193] env[69647]: INFO networking_nsxv3.common.synchronization [req-8a472b78-6463-4ed3-9889-05b46b510717 req-78b27246-3de3-4f26-b87f-84b32c112aad tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 806.560321] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 806.560788] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.560951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.561030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.561326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.561515] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.561639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.561774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.561904] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.561991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.562101] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.992043] env[69647]: INFO networking_nsxv3.common.synchronization [req-5c1c16c3-c580-4f5a-9054-3374128f373a req-58aca14c-68e7-4929-b93d-7ce112c6bfe2 service nova] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_rules [ 806.992335] env[69647]: INFO networking_nsxv3.common.synchronization [req-5c1c16c3-c580-4f5a-9054-3374128f373a req-58aca14c-68e7-4929-b93d-7ce112c6bfe2 service nova] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 806.992375] env[69647]: INFO networking_nsxv3.common.synchronization [req-5c1c16c3-c580-4f5a-9054-3374128f373a req-58aca14c-68e7-4929-b93d-7ce112c6bfe2 service nova] Enqueued Resource ID: c40ffc34-cc7f-49f8-a373-276e80d34e6c with Priority: HIGHEST for action port [ 806.992811] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_rules [ 806.992998] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 806.993161] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c40ffc34-cc7f-49f8-a373-276e80d34e6c with Priority: HIGHEST for action port [ 806.997544] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.997771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.997877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.998167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.998334] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.999845] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.999845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.999845] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c40ffc34-cc7f-49f8-a373-276e80d34e6c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.000122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c40ffc34-cc7f-49f8-a373-276e80d34e6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.006461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c40ffc34-cc7f-49f8-a373-276e80d34e6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.006461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c40ffc34-cc7f-49f8-a373-276e80d34e6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.006544] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c40ffc34-cc7f-49f8-a373-276e80d34e6c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.066625] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.066868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.066868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.067088] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.067180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.067370] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.067506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.067532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.067778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.067778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.067853] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 already deleted. [ 807.067878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.112113] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.112331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.112487] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.112796] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.113114] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.113294] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.113423] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.113677] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.113825] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.114046] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.114184] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.114313] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.114441] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.114568] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.114680] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.114852] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.134683] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.134904] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 807.134968] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.135194] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.135709] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1d869cd8-b26c-45c9-9dee-0452dd47d343 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.135818] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1d869cd8-b26c-45c9-9dee-0452dd47d343" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.135963] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1d869cd8-b26c-45c9-9dee-0452dd47d343" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.136318] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1d869cd8-b26c-45c9-9dee-0452dd47d343" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.136449] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d869cd8-b26c-45c9-9dee-0452dd47d343',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.502657] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 807.503599] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 deletion is rescheduled due to dependency. [ 807.503731] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.503902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.504155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.504386] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.504555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.504649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.504848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.504934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.505442] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.508778] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.508874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.509097] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c40ffc34-cc7f-49f8-a373-276e80d34e6c with status ACTIVE [ 807.509211] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.509313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.509378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.509571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.509659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.509828] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.509923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.509982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.510195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.510288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.510476] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.510571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.510631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.510770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.510843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.510926] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c40ffc34-cc7f-49f8-a373-276e80d34e6c is going to be updated. [ 807.544624] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.544772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.544854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.545036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.545179] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.545338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c40ffc34-cc7f-49f8-a373-276e80d34e6c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.591315] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 in Status: SUCCESS [ 807.591315] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 deletion is rescheduled due to dependency. [ 807.591458] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.644500] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.644500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.644500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.644500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.644500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.644500] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1d869cd8-b26c-45c9-9dee-0452dd47d343 not found, creating... [ 807.644500] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.644500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.644500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.644500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.644500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.645023] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.645023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.645023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.645023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.645023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.645023] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1d869cd8-b26c-45c9-9dee-0452dd47d343 is going to be created. [ 807.663353] env[69647]: INFO networking_nsxv3.common.synchronization [req-3debdaaf-4447-412f-9648-99395cf43c1a req-ce838760-97cf-4a80-9992-a1e9523530b4 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 807.663353] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 807.663353] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.663541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.663541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.663749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.663888] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.663999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.664145] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.664328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.664440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.664558] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.680683] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.680881] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.680998] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.681274] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.681571] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.681789] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1d869cd8-b26c-45c9-9dee-0452dd47d343" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.700819] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80142545-bab7-4367-b0e0-40b8e04f4503 in Status: SUCCESS [ 807.701045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.701203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.701462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.701674] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.701794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.701875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.702052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.702138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.702237] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.702456] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.007987] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.068455] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.068697] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-863" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.068823] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-863" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.069180] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-863" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.069458] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.069614] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.069730] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.070039] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.070221] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.070462] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 808.070630] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.070780] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.070916] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.071070] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 808.071207] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.071369] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.090287] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.090458] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 808.090644] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.090869] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-863" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.091240] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-b449577c-13c7-46ad-b48b-476d0feabfc7 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.091636] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.091636] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.091940] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.092155] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b449577c-13c7-46ad-b48b-476d0feabfc7',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.166292] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.166494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.166567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.166847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.166970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.167247] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.167359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.167446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.167666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.167771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.167867] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8129b6d-0cef-4795-92ca-b45484c4f512 already deleted. [ 808.167954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.204806] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.364981] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a in Status: SUCCESS [ 808.365375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.482167] env[69647]: INFO networking_nsxv3.common.synchronization [req-8a472b78-6463-4ed3-9889-05b46b510717 req-b0dde57c-ff5e-4035-b0e5-2e9b4b034feb service nova] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_rules [ 808.482529] env[69647]: INFO networking_nsxv3.common.synchronization [req-8a472b78-6463-4ed3-9889-05b46b510717 req-b0dde57c-ff5e-4035-b0e5-2e9b4b034feb service nova] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 808.482529] env[69647]: INFO networking_nsxv3.common.synchronization [req-8a472b78-6463-4ed3-9889-05b46b510717 req-b0dde57c-ff5e-4035-b0e5-2e9b4b034feb service nova] Enqueued Resource ID: 1d869cd8-b26c-45c9-9dee-0452dd47d343 with Priority: HIGHEST for action port [ 808.483289] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_rules [ 808.483289] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 808.483289] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d869cd8-b26c-45c9-9dee-0452dd47d343 with Priority: HIGHEST for action port [ 808.484222] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.484222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.484222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.484222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.484222] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.486336] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.486826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.486883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.487088] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.487556] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.488225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.488307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.488493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.488554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.488653] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.489466] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d869cd8-b26c-45c9-9dee-0452dd47d343 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.489578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d869cd8-b26c-45c9-9dee-0452dd47d343" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.489639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d869cd8-b26c-45c9-9dee-0452dd47d343" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.489792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d869cd8-b26c-45c9-9dee-0452dd47d343" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.489872] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d869cd8-b26c-45c9-9dee-0452dd47d343',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.510050] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.567239] env[69647]: INFO networking_nsxv3.common.synchronization [req-753652e1-3fb4-4987-bf7f-ac1432398d1b req-ddb4b61e-f9f8-4cf7-bb2c-138c91f1a721 tempest-ServersTestFqdnHostnames-1719574557 tempest-ServersTestFqdnHostnames-1719574557-project-member] Enqueued Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_members [ 808.567815] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca with Priority: HIGHEST for action security_group_members [ 808.568145] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.568271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.568353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.568593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.568772] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.568879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.568938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.571010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.571010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.571010] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c1ac393-0d0d-48c1-adc3-b358d19ecbca',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.597673] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.597889] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.598028] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.598335] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.598482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.598689] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port b449577c-13c7-46ad-b48b-476d0feabfc7 not found, creating... [ 808.599015] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.599204] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.599319] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.599631] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.599791] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.600129] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.600289] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.600408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.600621] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.600751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.600889] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: b449577c-13c7-46ad-b48b-476d0feabfc7 is going to be created. [ 808.622072] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.622072] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.622072] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.622307] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.622359] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.622618] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.706748] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80142545-bab7-4367-b0e0-40b8e04f4503: rpc.has_security_group_logging(os_id): False [ 808.731355] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.731355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.731355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.731355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.731560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.731825] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.731984] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.732109] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.732379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.732492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.732635] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80142545-bab7-4367-b0e0-40b8e04f4503 is going to be created. [ 808.820891] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.820891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.820891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.820891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.820891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.832525] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80142545-bab7-4367-b0e0-40b8e04f4503 in Status: IN_PROGRESS for 2s [ 808.995023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.995023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.995023] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.995023] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d869cd8-b26c-45c9-9dee-0452dd47d343 with status ACTIVE [ 808.995023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.995023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.995023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.995023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.995023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.995023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.995023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.995023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.995023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.995023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.995517] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.995517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.995517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.996025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.996265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.996470] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d869cd8-b26c-45c9-9dee-0452dd47d343 is going to be updated. [ 809.012088] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.013327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.013327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.013327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.013327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.013327] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 809.017571] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.017772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.017902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.018160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.018353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.018583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d869cd8-b26c-45c9-9dee-0452dd47d343" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.047190] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.047533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.047533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.047817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.048258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.055938] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 809.072303] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.072303] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.072303] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.072303] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.072596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.072596] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.072769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.072769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.073467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.073467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.073467] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca is going to be updated. [ 809.103082] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.103225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.103354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.103756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.103917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.116924] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca in Status: IN_PROGRESS for 2s [ 809.499088] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.903199] env[69647]: INFO networking_nsxv3.common.synchronization [req-3debdaaf-4447-412f-9648-99395cf43c1a req-e33de5b8-13f7-4653-bd86-05f9b761df38 service nova] Enqueued Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_rules [ 809.903374] env[69647]: INFO networking_nsxv3.common.synchronization [req-3debdaaf-4447-412f-9648-99395cf43c1a req-e33de5b8-13f7-4653-bd86-05f9b761df38 service nova] Enqueued Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 809.903510] env[69647]: INFO networking_nsxv3.common.synchronization [req-3debdaaf-4447-412f-9648-99395cf43c1a req-e33de5b8-13f7-4653-bd86-05f9b761df38 service nova] Enqueued Resource ID: b449577c-13c7-46ad-b48b-476d0feabfc7 with Priority: HIGHEST for action port [ 809.903752] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_rules [ 809.903914] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 809.904024] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b449577c-13c7-46ad-b48b-476d0feabfc7 with Priority: HIGHEST for action port [ 809.904587] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.904757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.904792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.905085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.905218] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.906054] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.906215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.906306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.906488] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.906636] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.906741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.906796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.910022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.910022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.910022] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.910022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b449577c-13c7-46ad-b48b-476d0feabfc7 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.910022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.910022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.910022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.910022] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b449577c-13c7-46ad-b48b-476d0feabfc7',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.001521] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.001741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.001826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.002017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.002117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.002399] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be created. [ 810.029665] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.030219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.030219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.030799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.031024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.043945] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: UNINITIALIZED for 2s [ 810.410959] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.411212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.411393] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.412327] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b449577c-13c7-46ad-b48b-476d0feabfc7 with status ACTIVE [ 810.412546] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.412670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.412745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.412928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.413029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.413181] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.413279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.413327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.414126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.414126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.414126] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.414126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.414126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.414126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.414600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.414600] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b449577c-13c7-46ad-b48b-476d0feabfc7 is going to be updated. [ 810.434317] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.434489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.434535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.434736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.434874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.435047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.843254] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80142545-bab7-4367-b0e0-40b8e04f4503 in Status: SUCCESS [ 810.843488] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.917210] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.070039] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 811.070336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.070481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.070700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.071757] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.071757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.071757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.071757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.071757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.071757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.071757] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.128860] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca in Status: SUCCESS [ 811.129104] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1ac393-0d0d-48c1-adc3-b358d19ecbca deletion is rescheduled due to dependency. [ 811.129226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1ac393-0d0d-48c1-adc3-b358d19ecbca" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.419752] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.419962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.420055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.420348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.420483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.420776] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8129b6d-0cef-4795-92ca-b45484c4f512 is going to be created. [ 811.444045] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.444238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.444334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.444686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.444896] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.454865] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: UNINITIALIZED for 2s [ 811.574049] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.574277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.574421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.574800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.575182] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.575406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.575550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.575868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.576051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.576254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.576543] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.576867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.576867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.577848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.578211] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.578352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.578450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.578755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.579226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.579451] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.580048] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.053769] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 812.053977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.054160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.054375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.054558] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.054671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.054732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.054884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.054958] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.055051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.055144] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.083233] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac810154-f096-4495-a2c8-d43e5bb3d1a2: rpc.has_security_group_logging(os_id): False [ 812.106312] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.106474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.106512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.106836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.106836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.106992] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.107105] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.107170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.107323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.107411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.107704] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.107704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.107801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.107866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.107936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.108131] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.108227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.108288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.108469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.108528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.108569] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 812.191171] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.191171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.191171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.191171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.191171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.211541] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 812.377805] env[69647]: INFO networking_nsxv3.common.synchronization [req-8480f962-308e-4921-a93f-dba2807f3fc2 req-1ada2c90-623e-4bc3-b43e-daa2b1cfdee3 tempest-ServersAdminTestJSON-1923625429 tempest-ServersAdminTestJSON-1923625429-project-member] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 812.378548] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 812.378861] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.382041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.382135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.382352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.382565] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.382671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.382741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.382955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.383058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.383170] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.558012] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.558185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.558261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.558478] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.558648] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.558743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.558806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.559042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.559042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.559150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.559275] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.559383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.559463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.559612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.559747] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.559850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.559910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.560061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.560138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.560214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.560300] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.841189] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-593 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.841189] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.841189] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.841189] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.841495] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.841551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.841686] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.841919] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.842105] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.842320] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.842455] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.842580] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.842693] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.842806] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.842923] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.843111] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.864019] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.864019] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.864019] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.864019] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.864019] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-ef8e485d-7570-4a96-8952-ca00dcad1725 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.864019] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-ef8e485d-7570-4a96-8952-ca00dcad1725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.864019] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-ef8e485d-7570-4a96-8952-ca00dcad1725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.864019] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-ef8e485d-7570-4a96-8952-ca00dcad1725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.864019] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef8e485d-7570-4a96-8952-ca00dcad1725',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.886587] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.062381] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9da9f265-ecd5-4341-a63a-3d1380826075: rpc.has_security_group_logging(os_id): False [ 813.079539] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.079703] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.079785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.080073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.080220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.080540] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.080706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.080815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.081075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.081703] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.081703] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.081703] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.081942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.081972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.082308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.082548] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.082700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.082806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.083816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.083816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.083816] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be created. [ 813.138879] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.139108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.139176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.139425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.139688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.150388] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 813.366467] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.366858] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.367125] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.367556] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.367822] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.368099] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port ef8e485d-7570-4a96-8952-ca00dcad1725 not found, creating... [ 813.368543] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.368815] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.369050] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.369867] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.370135] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.370605] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.370868] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.371078] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.371440] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.371674] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.371998] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: ef8e485d-7570-4a96-8952-ca00dcad1725 is going to be created. [ 813.391295] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.393918] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.394362] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.394488] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.394901] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.395278] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.395604] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-ef8e485d-7570-4a96-8952-ca00dcad1725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.468127] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: SUCCESS [ 813.468557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.468775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.469027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.469258] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.470332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.470332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.470332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.470332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.470332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.470541] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.576696] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec2a13d3-9132-43e0-bdf1-95f4897cbd71 req-4bdb1f87-d0ef-4f0f-90f0-43f1b5006a26 tempest-ListImageFiltersTestJSON-89573635 tempest-ListImageFiltersTestJSON-89573635-project-member] Enqueued Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 813.577301] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a with Priority: HIGHEST for action security_group_members [ 813.577641] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.577794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.577892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.578137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.578320] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.578478] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.579439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.579652] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.579784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.579966] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11aa9110-c05f-4ee9-95eb-9ace6aec4c6a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.897338] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.897512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.897601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.897823] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.897921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.898039] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 813.926015] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.926242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.926452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.926802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.927000] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.936514] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 813.973156] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.973333] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.973373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.973958] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.973958] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.974144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.974144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.974259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.978033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.978033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.978033] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.978033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.978033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.978033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.978033] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.978033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.978033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.978033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.978033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.978033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.978033] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.083195] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.083588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.083753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.084090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.086849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.086849] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.086849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.086849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.086849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.086849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.086849] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a is going to be updated. [ 814.115020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.115020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.115020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.115020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.115020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.122766] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: IN_PROGRESS for 2s [ 814.225759] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 814.225993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.480546] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8129b6d-0cef-4795-92ca-b45484c4f512: rpc.has_security_group_logging(os_id): False [ 814.506407] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.506407] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.506407] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.506407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.507708] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.507708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.507708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.507708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.507708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.507708] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8129b6d-0cef-4795-92ca-b45484c4f512 is going to be created. [ 814.507708] env[69647]: INFO networking_nsxv3.common.synchronization [req-8480f962-308e-4921-a93f-dba2807f3fc2 req-844d1e53-6967-47c0-ac57-210ed57365d3 service nova] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_rules [ 814.507708] env[69647]: INFO networking_nsxv3.common.synchronization [req-8480f962-308e-4921-a93f-dba2807f3fc2 req-844d1e53-6967-47c0-ac57-210ed57365d3 service nova] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 814.508511] env[69647]: INFO networking_nsxv3.common.synchronization [req-8480f962-308e-4921-a93f-dba2807f3fc2 req-844d1e53-6967-47c0-ac57-210ed57365d3 service nova] Enqueued Resource ID: ef8e485d-7570-4a96-8952-ca00dcad1725 with Priority: HIGHEST for action port [ 814.508511] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_rules [ 814.508590] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 814.508644] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef8e485d-7570-4a96-8952-ca00dcad1725 with Priority: HIGHEST for action port [ 814.508902] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.509016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.509103] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.509285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.509425] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.510209] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.510323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.514034] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef8e485d-7570-4a96-8952-ca00dcad1725 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.514034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef8e485d-7570-4a96-8952-ca00dcad1725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.514034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef8e485d-7570-4a96-8952-ca00dcad1725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.514034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef8e485d-7570-4a96-8952-ca00dcad1725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.514034] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef8e485d-7570-4a96-8952-ca00dcad1725',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.555946] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.556102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.556160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.556335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.556705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.566597] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: IN_PROGRESS for 2s [ 815.013477] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.013477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.016908] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef8e485d-7570-4a96-8952-ca00dcad1725 with status ACTIVE [ 815.016908] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.016908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.016908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.016908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.016908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.017184] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.017184] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.017184] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.017307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.017331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.017498] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.017594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.017664] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.017803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.017875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.017958] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef8e485d-7570-4a96-8952-ca00dcad1725 is going to be updated. [ 815.038636] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.038636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.038636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.038809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.039418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.039418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef8e485d-7570-4a96-8952-ca00dcad1725" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.127297] env[69647]: INFO networking_nsxv3.common.synchronization [req-382333e8-a53e-4f57-90e5-a4b8ad870d70 req-ca4c68cc-0cfb-49d9-90df-c3df55189667 tempest-InstanceActionsNegativeTestJSON-1087943826 tempest-InstanceActionsNegativeTestJSON-1087943826-project-member] Enqueued Resource ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 with Priority: HIGHEST for action security_group_members [ 815.127872] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 with Priority: HIGHEST for action security_group_members [ 815.128186] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.128309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.128404] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.128620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.128774] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.128877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.128997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.133286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.133391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.133493] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77dd37b2-e31a-46f5-9038-3a77c8bf3df2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.163410] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 815.163659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.636514] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.636721] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.636776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.637140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.637140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.637292] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.637361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.637424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.637589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.637653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.637742] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 already deleted. [ 815.637822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.794091] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.797429] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-578" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.799065] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-578" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.799065] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-578" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.799065] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.799065] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.799065] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.799065] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.799065] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.802153] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.802153] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.802153] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.802153] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.802153] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 815.802153] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.802153] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.820026] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.820026] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 815.820026] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.820026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-578" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.820026] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-2e868b05-3587-4f59-9407-4b2534443c46 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.820026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-2e868b05-3587-4f59-9407-4b2534443c46" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.820026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-2e868b05-3587-4f59-9407-4b2534443c46" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.820026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-2e868b05-3587-4f59-9407-4b2534443c46" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.820026] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e868b05-3587-4f59-9407-4b2534443c46',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.947033] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 815.949593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.949593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.949593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.949593] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.949593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.949593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.949593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.949593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.949593] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.133157] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a in Status: SUCCESS [ 816.133157] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11aa9110-c05f-4ee9-95eb-9ace6aec4c6a deletion is rescheduled due to dependency. [ 816.133157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11aa9110-c05f-4ee9-95eb-9ace6aec4c6a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.323557] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.323836] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.323970] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.324297] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.324471] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.324690] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 2e868b05-3587-4f59-9407-4b2534443c46 not found, creating... [ 816.324979] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.325177] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.325327] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.325580] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.325768] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.326452] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.326750] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.326922] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.327224] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.327401] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.327606] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 2e868b05-3587-4f59-9407-4b2534443c46 is going to be created. [ 816.346773] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.347434] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.347729] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.348082] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.348381] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.348665] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-2e868b05-3587-4f59-9407-4b2534443c46" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.451902] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.577547] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: SUCCESS [ 816.577947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.954554] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.456626] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.457126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.457126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.457126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.457227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.457315] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 817.486450] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.486450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.486450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.486450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.486450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.497707] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 817.675760] env[69647]: INFO networking_nsxv3.common.synchronization [req-382333e8-a53e-4f57-90e5-a4b8ad870d70 req-589c3d99-4adf-45e5-af30-5a90312a45dc service nova] Enqueued Resource ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 with Priority: HIGHEST for action security_group_rules [ 817.675953] env[69647]: INFO networking_nsxv3.common.synchronization [req-382333e8-a53e-4f57-90e5-a4b8ad870d70 req-589c3d99-4adf-45e5-af30-5a90312a45dc service nova] Enqueued Resource ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 with Priority: HIGHEST for action security_group_members [ 817.676110] env[69647]: INFO networking_nsxv3.common.synchronization [req-382333e8-a53e-4f57-90e5-a4b8ad870d70 req-589c3d99-4adf-45e5-af30-5a90312a45dc service nova] Enqueued Resource ID: 2e868b05-3587-4f59-9407-4b2534443c46 with Priority: HIGHEST for action port [ 817.676349] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 with Priority: HIGHEST for action security_group_rules [ 817.676478] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 with Priority: HIGHEST for action security_group_members [ 817.676571] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e868b05-3587-4f59-9407-4b2534443c46 with Priority: HIGHEST for action port [ 817.677114] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77dd37b2-e31a-46f5-9038-3a77c8bf3df2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.677352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.677451] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.677793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.677883] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77dd37b2-e31a-46f5-9038-3a77c8bf3df2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.678708] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.678792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.678877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.679054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.679274] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.679364] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.679364] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.679481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.679561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.679649] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77dd37b2-e31a-46f5-9038-3a77c8bf3df2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.684106] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e868b05-3587-4f59-9407-4b2534443c46 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.684106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e868b05-3587-4f59-9407-4b2534443c46" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.684106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e868b05-3587-4f59-9407-4b2534443c46" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.684106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e868b05-3587-4f59-9407-4b2534443c46" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.684106] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e868b05-3587-4f59-9407-4b2534443c46',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.183318] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.183508] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.183562] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77dd37b2-e31a-46f5-9038-3a77c8bf3df2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.185763] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e868b05-3587-4f59-9407-4b2534443c46 with status ACTIVE [ 818.185962] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.186098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.186152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.186352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.186441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.186609] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.186706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.186764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.186909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.186984] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.187198] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.187289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.187347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.187486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.187559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.187639] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e868b05-3587-4f59-9407-4b2534443c46 is going to be updated. [ 818.216110] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.216264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.216299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.216515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.216663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.216905] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e868b05-3587-4f59-9407-4b2534443c46" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.686105] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77dd37b2-e31a-46f5-9038-3a77c8bf3df2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.188847] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.189029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.189103] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.189314] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.189405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.189503] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 is going to be created. [ 819.214840] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.214988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.215073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.215283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.215457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.226689] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 in Status: UNINITIALIZED for 2s [ 819.506260] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 819.506593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.506593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.506740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.506913] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.507046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.507110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.507261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.507335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.507427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.507508] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.010530] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.010863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.010863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.011028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.011632] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.011758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.011808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.011966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.012075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.012163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.012334] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.012480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.012480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.012685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.012826] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.012924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.012992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.013250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.013339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.013424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.013611] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.520293] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27b912c1-294b-407e-bd8a-c81f04912b02: rpc.has_security_group_logging(os_id): False [ 820.537616] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.537856] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.537926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.538230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.538230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.538421] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.538512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.538573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.538717] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.538788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.538962] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.539071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.539129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.539264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.539336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.539552] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.539642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.539700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.539871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.539901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.539981] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 820.611132] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.611281] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.611354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.611688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.611770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.628973] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 821.236207] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 in Status: SUCCESS [ 821.236548] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.236741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.236999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.237282] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.237433] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.237545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.237754] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.238631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.238631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.238631] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77dd37b2-e31a-46f5-9038-3a77c8bf3df2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.742728] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.742916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.742945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.743196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.743374] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.743483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.743544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.743729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.743873] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.744036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.744123] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.744214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.744850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.744850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.744850] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.744850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.744850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.744850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.745079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.745079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.745079] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77dd37b2-e31a-46f5-9038-3a77c8bf3df2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.831874] env[69647]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 821.832026] env[69647]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] NSXv3 Agent Agent loop - iteration:1 started [ 822.143630] env[69647]: INFO networking_nsxv3.common.synchronization [req-2d0f4c6e-9ed2-4e3d-8c92-68086557f802 req-25afb1cc-1136-4033-8863-9cde48480806 tempest-ServersNegativeTestJSON-2024807649 tempest-ServersNegativeTestJSON-2024807649-project-member] Enqueued Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 822.144187] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 822.144483] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.144622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.144703] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.144967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.146516] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.146646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.146719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.146908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.147093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.147220] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.244518] env[69647]: INFO networking_nsxv3.common.synchronization [req-40f63735-9dfd-4fef-883f-7b9f4ce3e04b req-59da4089-5b4e-472e-b641-381e5eb76734 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 822.244518] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 822.244518] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.244953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.244953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.245033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.246422] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.246538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.250059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.250059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.250059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.250059] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.250059] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77dd37b2-e31a-46f5-9038-3a77c8bf3df2: rpc.has_security_group_logging(os_id): False [ 822.272163] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.272163] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.272163] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.272163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.273869] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.273869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.273869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.273869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.273869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.273869] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 is going to be created. [ 822.346113] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.346234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.346234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.348895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.348895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.358031] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 in Status: IN_PROGRESS for 2s [ 822.643150] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-878 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.643150] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.643150] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.643150] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.643150] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.643515] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.643925] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.644301] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.644564] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.644960] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.645165] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.645358] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.645548] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.645742] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.645925] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.646174] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.648421] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 822.648694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.650900] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.651834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.651834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.652072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.656740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.656740] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.656740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.656740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.656954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.656954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.657030] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 already deleted. [ 822.657167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.666674] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.668019] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 822.668019] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.668019] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.668019] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1e6a7509-0b62-47da-8ef9-6848daff80b6 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.668019] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.669941] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.670533] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.670612] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e6a7509-0b62-47da-8ef9-6848daff80b6',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.754746] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.754746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.754746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.754746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.754746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.754746] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.754746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.754746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.754746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.754746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.754746] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be updated. [ 822.776272] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.776428] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.776503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.776725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.776870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.786214] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 823.176975] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.177338] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.177633] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.178220] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.178620] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.178904] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1e6a7509-0b62-47da-8ef9-6848daff80b6 not found, creating... [ 823.179263] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.180017] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.180218] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.180613] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.183030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.183030] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.183030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.183030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.183030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.183030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.183030] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1e6a7509-0b62-47da-8ef9-6848daff80b6 is going to be created. [ 823.210676] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.211034] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.211311] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.213386] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.213508] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.213859] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.135832] env[69647]: INFO networking_nsxv3.common.synchronization [None req-a337f3ba-6b2a-4290-a755-7e9a0266fbaf None None] Enqueued Resource ID: e93723cb-a6e9-441f-89d2-18e526c431d0 with Priority: HIGHEST for action port [ 824.140665] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e93723cb-a6e9-441f-89d2-18e526c431d0 with Priority: HIGHEST for action port [ 824.140665] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-e93723cb-a6e9-441f-89d2-18e526c431d0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.140665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e93723cb-a6e9-441f-89d2-18e526c431d0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.140665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e93723cb-a6e9-441f-89d2-18e526c431d0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.140665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e93723cb-a6e9-441f-89d2-18e526c431d0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.140665] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e93723cb-a6e9-441f-89d2-18e526c431d0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.374567] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 in Status: SUCCESS [ 824.374842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.642260] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e93723cb-a6e9-441f-89d2-18e526c431d0 [ 824.642697] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.642919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.643116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.643402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.643547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.643725] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e93723cb-a6e9-441f-89d2-18e526c431d0 already deleted. [ 824.643900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e93723cb-a6e9-441f-89d2-18e526c431d0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.798208] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 824.798412] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 deletion is rescheduled due to dependency. [ 824.798530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.055193] env[69647]: INFO networking_nsxv3.common.synchronization [req-2d0f4c6e-9ed2-4e3d-8c92-68086557f802 req-a283cb48-864a-4e91-84c7-f6558dee4625 service nova] Enqueued Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_rules [ 825.055423] env[69647]: INFO networking_nsxv3.common.synchronization [req-2d0f4c6e-9ed2-4e3d-8c92-68086557f802 req-a283cb48-864a-4e91-84c7-f6558dee4625 service nova] Enqueued Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 825.055520] env[69647]: INFO networking_nsxv3.common.synchronization [req-2d0f4c6e-9ed2-4e3d-8c92-68086557f802 req-a283cb48-864a-4e91-84c7-f6558dee4625 service nova] Enqueued Resource ID: 1e6a7509-0b62-47da-8ef9-6848daff80b6 with Priority: HIGHEST for action port [ 825.055783] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_rules [ 825.055917] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 825.056025] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e6a7509-0b62-47da-8ef9-6848daff80b6 with Priority: HIGHEST for action port [ 825.056571] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.056760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.056760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.057006] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.057219] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.058145] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.058295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.058385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.058582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.058762] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.058894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.059279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.059279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.059279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.059279] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.060267] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e6a7509-0b62-47da-8ef9-6848daff80b6 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.060439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.060566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.060756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.060838] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e6a7509-0b62-47da-8ef9-6848daff80b6',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.563318] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.564552] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.564716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.564855] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e6a7509-0b62-47da-8ef9-6848daff80b6 with status ACTIVE [ 825.565327] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.565327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.565327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.565660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.565793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.566545] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.566545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.566545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.566545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.566545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.566899] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.566899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.567011] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.567154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.567264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.567356] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e6a7509-0b62-47da-8ef9-6848daff80b6 is going to be updated. [ 825.588038] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.588210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.588281] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.588511] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.588716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.588922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.790686] env[69647]: INFO networking_nsxv3.common.synchronization [req-a654c5c2-33c6-42ed-8aad-e41644083bd0 req-8fd8a1ac-0d62-452b-a579-1d6e0c2a7c4c tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_members [ 825.791560] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGHEST for action security_group_members [ 825.791710] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-df955150-4015-4c07-90e5-0a793c5a1b3b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.791809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.791809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.792031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.792184] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.792425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.792425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.792551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.792551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.792657] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df955150-4015-4c07-90e5-0a793c5a1b3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.069361] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.297829] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.298272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.298439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.298923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.299023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.299272] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.299455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.299530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.299802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.299925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.300079] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df955150-4015-4c07-90e5-0a793c5a1b3b is going to be updated. [ 826.328938] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.329149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.329229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.330513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.330736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.339180] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df955150-4015-4c07-90e5-0a793c5a1b3b in Status: IN_PROGRESS for 2s [ 826.574180] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.577499] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.577499] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.577499] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.577624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.577624] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 is going to be created. [ 826.603246] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.603246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.603246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.603246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.603246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.612227] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: UNINITIALIZED for 2s [ 827.293075] env[69647]: INFO networking_nsxv3.common.synchronization [None req-baf7545f-fe57-4a71-b787-f6648f45c81b None None] Enqueued Resource ID: 2e614e98-9a1d-4697-b1d5-92504d027ffe with Priority: HIGHEST for action port [ 827.293337] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e614e98-9a1d-4697-b1d5-92504d027ffe with Priority: HIGHEST for action port [ 827.294313] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e614e98-9a1d-4697-b1d5-92504d027ffe taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.294313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e614e98-9a1d-4697-b1d5-92504d027ffe" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.294313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e614e98-9a1d-4697-b1d5-92504d027ffe" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.294508] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e614e98-9a1d-4697-b1d5-92504d027ffe" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.294508] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e614e98-9a1d-4697-b1d5-92504d027ffe',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.797209] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e614e98-9a1d-4697-b1d5-92504d027ffe [ 827.797611] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.797611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.797812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.797878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.797959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.798078] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e614e98-9a1d-4697-b1d5-92504d027ffe already deleted. [ 827.798443] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e614e98-9a1d-4697-b1d5-92504d027ffe" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.349532] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df955150-4015-4c07-90e5-0a793c5a1b3b in Status: SUCCESS [ 828.349791] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df955150-4015-4c07-90e5-0a793c5a1b3b deletion is rescheduled due to dependency. [ 828.349942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.622103] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: SUCCESS [ 828.622415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.622759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.623575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.623575] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.623575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.623575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.623848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.623848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.623927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.624184] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.128174] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.128174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.128174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.128664] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.128664] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.128664] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.128664] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.128832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.129133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.129133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.129301] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.129301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.129550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.129550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.129698] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.129777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.129859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.130047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.130221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.130315] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.130315] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.632367] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 690e1872-1ae4-4c49-8159-ec39c82e2868: rpc.has_security_group_logging(os_id): False [ 829.648841] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.649098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.649227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.649554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.649647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.649923] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.650096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.650212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.650432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.650558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.650814] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.650965] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.651089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.651286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.651408] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.651660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.651801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.651906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.652140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.652271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.652411] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 is going to be created. [ 829.714281] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.714444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.714555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.714784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.714935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.725679] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: IN_PROGRESS for 2s [ 831.743639] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: SUCCESS [ 831.743986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.098046] env[69647]: INFO networking_nsxv3.common.synchronization [None req-3b786141-f962-4757-b18d-3d92c09a6cb8 tempest-MigrationsAdminTest-1337534586 tempest-MigrationsAdminTest-1337534586-project-member] Enqueued Resource ID: 17ba3553-2ebc-4073-bc89-a66287115f7e with Priority: HIGHEST for action security_group_rules [ 832.098347] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17ba3553-2ebc-4073-bc89-a66287115f7e with Priority: HIGHEST for action security_group_rules [ 832.098666] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17ba3553-2ebc-4073-bc89-a66287115f7e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.098792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17ba3553-2ebc-4073-bc89-a66287115f7e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.098860] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17ba3553-2ebc-4073-bc89-a66287115f7e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.101274] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17ba3553-2ebc-4073-bc89-a66287115f7e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.102571] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17ba3553-2ebc-4073-bc89-a66287115f7e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.112093] env[69647]: INFO networking_nsxv3.common.synchronization [req-e2ad6984-88cb-4f5b-91d8-8a4069d1db05 req-fdaf13ea-d1f7-4442-b374-2a18eb25d188 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 832.112402] env[69647]: INFO networking_nsxv3.common.synchronization [req-e2ad6984-88cb-4f5b-91d8-8a4069d1db05 req-fdaf13ea-d1f7-4442-b374-2a18eb25d188 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: fb82badc-5a50-4e87-9287-97ed3ba10020 with Priority: HIGHEST for action security_group_members [ 832.113000] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 832.113194] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb82badc-5a50-4e87-9287-97ed3ba10020 with Priority: HIGHEST for action security_group_members [ 832.113512] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.113674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.113809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.114093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.114692] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.114692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.114692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.114692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.114692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.114908] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.115672] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb82badc-5a50-4e87-9287-97ed3ba10020 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.115768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.115842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.116051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.116962] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.116962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.116962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.116962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.117152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.117339] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb82badc-5a50-4e87-9287-97ed3ba10020',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.227491] env[69647]: INFO networking_nsxv3.common.synchronization [None req-e7f37562-30d9-4d46-85dd-b624d055172b tempest-MigrationsAdminTest-1337534586 tempest-MigrationsAdminTest-1337534586-project-member] Enqueued Resource ID: 17ba3553-2ebc-4073-bc89-a66287115f7e with Priority: HIGHEST for action security_group_rules [ 832.228062] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17ba3553-2ebc-4073-bc89-a66287115f7e with Priority: HIGHEST for action security_group_rules [ 832.228425] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17ba3553-2ebc-4073-bc89-a66287115f7e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.228545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17ba3553-2ebc-4073-bc89-a66287115f7e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.230581] env[69647]: INFO networking_nsxv3.common.synchronization [req-e2ad6984-88cb-4f5b-91d8-8a4069d1db05 req-fdaf13ea-d1f7-4442-b374-2a18eb25d188 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_rules [ 832.230796] env[69647]: INFO networking_nsxv3.common.synchronization [req-e2ad6984-88cb-4f5b-91d8-8a4069d1db05 req-fdaf13ea-d1f7-4442-b374-2a18eb25d188 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 832.230971] env[69647]: INFO networking_nsxv3.common.synchronization [req-e2ad6984-88cb-4f5b-91d8-8a4069d1db05 req-fdaf13ea-d1f7-4442-b374-2a18eb25d188 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: fb82badc-5a50-4e87-9287-97ed3ba10020 with Priority: HIGHEST for action security_group_rules [ 832.231167] env[69647]: INFO networking_nsxv3.common.synchronization [req-e2ad6984-88cb-4f5b-91d8-8a4069d1db05 req-fdaf13ea-d1f7-4442-b374-2a18eb25d188 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: fb82badc-5a50-4e87-9287-97ed3ba10020 with Priority: HIGHEST for action security_group_members [ 832.231408] env[69647]: INFO networking_nsxv3.common.synchronization [req-e2ad6984-88cb-4f5b-91d8-8a4069d1db05 req-fdaf13ea-d1f7-4442-b374-2a18eb25d188 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: b449577c-13c7-46ad-b48b-476d0feabfc7 with Priority: HIGHEST for action port [ 832.233273] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_rules [ 832.233448] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb82badc-5a50-4e87-9287-97ed3ba10020 with Priority: HIGHEST for action security_group_rules [ 832.233623] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b449577c-13c7-46ad-b48b-476d0feabfc7 with Priority: HIGHEST for action port [ 832.233815] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 832.233924] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb82badc-5a50-4e87-9287-97ed3ba10020 with Priority: HIGHEST for action security_group_members [ 832.234875] env[69647]: INFO networking_nsxv3.common.synchronization [req-7071ebf6-f291-4935-8808-50778c9529f3 req-b04e8aee-d2b8-4634-acf0-c2fb4fcd9c82 tempest-ServerAddressesTestJSON-1237503775 tempest-ServerAddressesTestJSON-1237503775-project-member] Enqueued Resource ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 with Priority: HIGHEST for action security_group_members [ 832.235282] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.235434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.235576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.235876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.236036] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.244176] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb82badc-5a50-4e87-9287-97ed3ba10020 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.244176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.244176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.244176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.244176] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb82badc-5a50-4e87-9287-97ed3ba10020',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.244591] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b449577c-13c7-46ad-b48b-476d0feabfc7 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.244712] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.244818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.245051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.245200] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b449577c-13c7-46ad-b48b-476d0feabfc7',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.246827] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.246827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.246827] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb82badc-5a50-4e87-9287-97ed3ba10020 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.246827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.248580] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 with Priority: HIGHEST for action security_group_members [ 832.250718] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffc805fb-8c1f-41b4-83d2-89346f31ff05 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.250718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.250718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.250718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.250718] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.250718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.250718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.250992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.250992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.253479] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffc805fb-8c1f-41b4-83d2-89346f31ff05',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.622691] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.624042] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb82badc-5a50-4e87-9287-97ed3ba10020',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.674594] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.674594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.674594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.674594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.674594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.674594] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17ba3553-2ebc-4073-bc89-a66287115f7e already deleted. [ 832.674594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17ba3553-2ebc-4073-bc89-a66287115f7e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.674594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17ba3553-2ebc-4073-bc89-a66287115f7e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.674594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17ba3553-2ebc-4073-bc89-a66287115f7e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.674594] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17ba3553-2ebc-4073-bc89-a66287115f7e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.751300] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb82badc-5a50-4e87-9287-97ed3ba10020 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.751300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.751300] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b449577c-13c7-46ad-b48b-476d0feabfc7 with status ACTIVE [ 832.751300] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.751300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.751300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.751300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.751300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.751300] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.751300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.751300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.751300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.751300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.752058] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.752058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.752058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.752058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.752058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.752058] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b449577c-13c7-46ad-b48b-476d0feabfc7 is going to be updated. [ 832.753686] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.753805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.754425] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.754576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.754753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.754864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.754971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.755181] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.755313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.755402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.755576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.755683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.755793] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 already deleted. [ 832.755905] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.773814] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.774053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.774174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.774472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.774759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.775032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.879124] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.879124] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-916" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.879124] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-916" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.879124] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-916" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.879124] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.879124] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.879124] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.879413] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.879482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.879700] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.879810] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.880137] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.880137] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.880137] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.880234] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.880368] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.901845] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.902518] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.902518] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.904360] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-916" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.904751] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1378e16c-c6d7-4a2b-9634-b8065ec909df taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.904969] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1378e16c-c6d7-4a2b-9634-b8065ec909df" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.905143] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1378e16c-c6d7-4a2b-9634-b8065ec909df" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.906134] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1378e16c-c6d7-4a2b-9634-b8065ec909df" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.906134] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1378e16c-c6d7-4a2b-9634-b8065ec909df',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.043434] env[69647]: INFO networking_nsxv3.common.synchronization [req-dce28bbb-e1dc-4bfa-94a5-f754ba398ec6 req-1433e03e-f2e8-4620-b49e-5c9559dcd370 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 833.043909] env[69647]: INFO networking_nsxv3.common.synchronization [req-dce28bbb-e1dc-4bfa-94a5-f754ba398ec6 req-1433e03e-f2e8-4620-b49e-5c9559dcd370 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: fb82badc-5a50-4e87-9287-97ed3ba10020 with Priority: HIGHEST for action security_group_members [ 833.044309] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 833.044483] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb82badc-5a50-4e87-9287-97ed3ba10020 with Priority: HIGHEST for action security_group_members [ 833.044802] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.044913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.046122] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb82badc-5a50-4e87-9287-97ed3ba10020 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.046122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.093052] env[69647]: INFO networking_nsxv3.common.synchronization [req-dce28bbb-e1dc-4bfa-94a5-f754ba398ec6 req-1433e03e-f2e8-4620-b49e-5c9559dcd370 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_rules [ 833.093052] env[69647]: INFO networking_nsxv3.common.synchronization [req-dce28bbb-e1dc-4bfa-94a5-f754ba398ec6 req-1433e03e-f2e8-4620-b49e-5c9559dcd370 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 833.093052] env[69647]: INFO networking_nsxv3.common.synchronization [req-dce28bbb-e1dc-4bfa-94a5-f754ba398ec6 req-1433e03e-f2e8-4620-b49e-5c9559dcd370 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: b449577c-13c7-46ad-b48b-476d0feabfc7 with Priority: HIGHEST for action port [ 833.093870] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_rules [ 833.094423] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 833.095361] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b449577c-13c7-46ad-b48b-476d0feabfc7 with Priority: HIGHEST for action port [ 833.097106] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.097106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.097106] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.097106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.101384] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b449577c-13c7-46ad-b48b-476d0feabfc7 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.101384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.101384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.101666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.101666] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b449577c-13c7-46ad-b48b-476d0feabfc7',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.126131] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.130341] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb82badc-5a50-4e87-9287-97ed3ba10020',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.197830] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.198078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.198149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.198434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.198559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.198686] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17ba3553-2ebc-4073-bc89-a66287115f7e already deleted. [ 833.198816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17ba3553-2ebc-4073-bc89-a66287115f7e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.410139] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.410139] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.410139] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.410370] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.410500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.410777] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1378e16c-c6d7-4a2b-9634-b8065ec909df not found, creating... [ 833.411223] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.411434] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.411705] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.412056] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.412272] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.412630] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.412852] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.413287] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.413287] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.413549] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.413600] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1378e16c-c6d7-4a2b-9634-b8065ec909df is going to be created. [ 833.432509] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.432679] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.432760] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.433511] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.433511] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.433627] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1378e16c-c6d7-4a2b-9634-b8065ec909df" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.603546] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b449577c-13c7-46ad-b48b-476d0feabfc7 with status ACTIVE [ 833.603954] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.604063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.604168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.604525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.604754] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.604940] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.605123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.605240] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.605490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.605625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.605980] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.606117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.606223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.606455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.606586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.606743] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b449577c-13c7-46ad-b48b-476d0feabfc7 is going to be updated. [ 833.626861] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.626861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.626861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.627286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.627286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.627374] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b449577c-13c7-46ad-b48b-476d0feabfc7" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.630226] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.630373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.630452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.630697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.630831] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.630947] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8129b6d-0cef-4795-92ca-b45484c4f512 is going to be updated. [ 833.632393] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.632544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.632641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.632836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.632924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.633028] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb82badc-5a50-4e87-9287-97ed3ba10020 is going to be created. [ 833.666304] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.666386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.666449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.666627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.666789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.668932] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.669236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.669332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.669523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.669660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.688581] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: IN_PROGRESS for 2s [ 833.689742] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb82badc-5a50-4e87-9287-97ed3ba10020 in Status: UNINITIALIZED for 2s [ 834.086425] env[69647]: INFO networking_nsxv3.common.synchronization [req-3a0d4736-367a-4982-81a5-78c3353b7345 req-4793dc3a-aefc-450b-a819-4a3db6e3d731 tempest-InstanceActionsNegativeTestJSON-1087943826 tempest-InstanceActionsNegativeTestJSON-1087943826-project-member] Enqueued Resource ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 with Priority: HIGHEST for action security_group_members [ 834.087008] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 with Priority: HIGHEST for action security_group_members [ 834.087316] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.087454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.087503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.087701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.088016] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.088016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.088016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.088660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.088788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.089032] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77dd37b2-e31a-46f5-9038-3a77c8bf3df2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.320703] env[69647]: INFO networking_nsxv3.common.synchronization [req-7071ebf6-f291-4935-8808-50778c9529f3 req-4f5d8c7b-387a-495c-b971-2b71291e8ec4 service nova] Enqueued Resource ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 with Priority: HIGHEST for action security_group_rules [ 834.320895] env[69647]: INFO networking_nsxv3.common.synchronization [req-7071ebf6-f291-4935-8808-50778c9529f3 req-4f5d8c7b-387a-495c-b971-2b71291e8ec4 service nova] Enqueued Resource ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 with Priority: HIGHEST for action security_group_members [ 834.321046] env[69647]: INFO networking_nsxv3.common.synchronization [req-7071ebf6-f291-4935-8808-50778c9529f3 req-4f5d8c7b-387a-495c-b971-2b71291e8ec4 service nova] Enqueued Resource ID: 1378e16c-c6d7-4a2b-9634-b8065ec909df with Priority: HIGHEST for action port [ 834.321284] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 with Priority: HIGHEST for action security_group_rules [ 834.321470] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 with Priority: HIGHEST for action security_group_members [ 834.321555] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1378e16c-c6d7-4a2b-9634-b8065ec909df with Priority: HIGHEST for action port [ 834.322825] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffc805fb-8c1f-41b4-83d2-89346f31ff05 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.322947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.322947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.323199] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.323292] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffc805fb-8c1f-41b4-83d2-89346f31ff05',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.324482] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffc805fb-8c1f-41b4-83d2-89346f31ff05 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.324599] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.324663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.324840] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.324990] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.325097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.325158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.325304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.325388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.325480] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffc805fb-8c1f-41b4-83d2-89346f31ff05',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.326226] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1378e16c-c6d7-4a2b-9634-b8065ec909df taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.326335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1378e16c-c6d7-4a2b-9634-b8065ec909df" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.326401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1378e16c-c6d7-4a2b-9634-b8065ec909df" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.326548] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1378e16c-c6d7-4a2b-9634-b8065ec909df" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.326623] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1378e16c-c6d7-4a2b-9634-b8065ec909df',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.592792] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.592939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.593040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.593260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.593535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.593624] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.593776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.593947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.594218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.594322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.594524] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 is going to be updated. [ 834.610872] env[69647]: INFO networking_nsxv3.common.synchronization [req-7bc60785-88a2-420d-bd9b-629c9d2cd2b6 req-b8297a18-579a-4b39-b140-d1ea810a19e0 tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 834.610872] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 834.611161] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.611293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.611362] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.611676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.611870] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.612191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.612191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.612327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.612327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.612451] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.618381] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.620207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.620207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.620207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.620207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.627994] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 in Status: IN_PROGRESS for 2s [ 834.829622] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffc805fb-8c1f-41b4-83d2-89346f31ff05',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.831702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffc805fb-8c1f-41b4-83d2-89346f31ff05 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.836323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.836826] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1378e16c-c6d7-4a2b-9634-b8065ec909df with status ACTIVE [ 834.837133] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.837319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.837423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.839076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.839223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.839613] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.839739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.839805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.839996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.840095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.840592] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.840690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.840870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.840924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.840987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.841077] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1378e16c-c6d7-4a2b-9634-b8065ec909df is going to be updated. [ 834.843284] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffc805fb-8c1f-41b4-83d2-89346f31ff05',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.876377] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.876614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.876661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.876901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.877074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.877308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1378e16c-c6d7-4a2b-9634-b8065ec909df" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.046288] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.046288] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.046536] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.046642] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.046874] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.047037] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.047210] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.047440] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.047582] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.047785] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.047895] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.048009] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.048125] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.048233] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.048338] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.048483] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.068276] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.068447] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.068585] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.068770] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.069101] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-c665e725-5432-4829-92bd-bd7e5b59f08f taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.069281] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-c665e725-5432-4829-92bd-bd7e5b59f08f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.069387] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-c665e725-5432-4829-92bd-bd7e5b59f08f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.069763] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-c665e725-5432-4829-92bd-bd7e5b59f08f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.069892] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c665e725-5432-4829-92bd-bd7e5b59f08f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.115784] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.115784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.115784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.115784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.115784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.115784] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.116799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.116799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.116799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.116799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.116799] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 835.148807] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.148950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.149069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.149318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.149592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.157835] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 835.346534] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.346694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.346754] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.346966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.347065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.347165] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 is going to be created. [ 835.371369] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.371627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.371627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.374084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.374084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.385096] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 in Status: UNINITIALIZED for 2s [ 835.571955] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.572144] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.572273] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.572560] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.572746] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.572910] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port c665e725-5432-4829-92bd-bd7e5b59f08f not found, creating... [ 835.573180] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.573336] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.573450] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.573702] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.573802] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.574153] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.574450] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.574450] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.575009] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.575197] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.575379] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: c665e725-5432-4829-92bd-bd7e5b59f08f is going to be created. [ 835.597850] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.598131] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.598261] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.598535] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.598761] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.598980] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-c665e725-5432-4829-92bd-bd7e5b59f08f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.702698] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb82badc-5a50-4e87-9287-97ed3ba10020 in Status: SUCCESS [ 835.702968] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.703230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.703475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.704073] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.704236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.704328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.704515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.704640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.704747] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb82badc-5a50-4e87-9287-97ed3ba10020',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.706271] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: SUCCESS [ 835.710057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.710057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.710594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.710594] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.710594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.710594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.710784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.710784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.710845] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.212712] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.213028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.213028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.213293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.214305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.214305] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.214305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.214305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.214305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.214305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.214570] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb82badc-5a50-4e87-9287-97ed3ba10020 is going to be deleted. [ 836.215785] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.274094] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.274263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.274306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.274541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.274631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.274746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.275348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.275505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.275696] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.275820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.275872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.275971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.276602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.276765] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb82badc-5a50-4e87-9287-97ed3ba10020',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.551877] env[69647]: INFO networking_nsxv3.common.synchronization [None req-68f61df4-fc10-455a-b091-18a9b841671d None None] Enqueued Resource ID: b439ebfc-2f04-4814-a7e7-bdb16006570e with Priority: HIGHEST for action port [ 836.554662] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b439ebfc-2f04-4814-a7e7-bdb16006570e with Priority: HIGHEST for action port [ 836.554662] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b439ebfc-2f04-4814-a7e7-bdb16006570e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.554662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b439ebfc-2f04-4814-a7e7-bdb16006570e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.554662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b439ebfc-2f04-4814-a7e7-bdb16006570e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.554662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b439ebfc-2f04-4814-a7e7-bdb16006570e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.555101] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b439ebfc-2f04-4814-a7e7-bdb16006570e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.637645] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 in Status: SUCCESS [ 836.637830] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 deletion is rescheduled due to dependency. [ 836.638131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.718553] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.762945] env[69647]: INFO networking_nsxv3.common.synchronization [req-7bc60785-88a2-420d-bd9b-629c9d2cd2b6 req-81db0807-503e-4933-bdc5-790b8738c9f8 service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 836.763147] env[69647]: INFO networking_nsxv3.common.synchronization [req-7bc60785-88a2-420d-bd9b-629c9d2cd2b6 req-81db0807-503e-4933-bdc5-790b8738c9f8 service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 836.763312] env[69647]: INFO networking_nsxv3.common.synchronization [req-7bc60785-88a2-420d-bd9b-629c9d2cd2b6 req-81db0807-503e-4933-bdc5-790b8738c9f8 service nova] Enqueued Resource ID: c665e725-5432-4829-92bd-bd7e5b59f08f with Priority: HIGHEST for action port [ 836.763530] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 836.763627] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 836.763727] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c665e725-5432-4829-92bd-bd7e5b59f08f with Priority: HIGHEST for action port [ 836.764825] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.765165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.765165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.765267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.765370] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.766242] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.766335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.766520] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c665e725-5432-4829-92bd-bd7e5b59f08f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.766613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c665e725-5432-4829-92bd-bd7e5b59f08f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.766695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c665e725-5432-4829-92bd-bd7e5b59f08f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.766969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c665e725-5432-4829-92bd-bd7e5b59f08f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.767056] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c665e725-5432-4829-92bd-bd7e5b59f08f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.780312] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.780890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.781099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.781359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.781462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.781710] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.781817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.781881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.782050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.782132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.782221] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb82badc-5a50-4e87-9287-97ed3ba10020 already deleted. [ 836.782302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.782404] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb82badc-5a50-4e87-9287-97ed3ba10020',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.784800] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.784800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.786026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.786026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.786026] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.786788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.786966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.787251] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.787251] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.787357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.787601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.787601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.787601] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb82badc-5a50-4e87-9287-97ed3ba10020',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.058313] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b439ebfc-2f04-4814-a7e7-bdb16006570e [ 837.058313] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.058313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.058313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.058313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.058313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.058313] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b439ebfc-2f04-4814-a7e7-bdb16006570e already deleted. [ 837.058313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b439ebfc-2f04-4814-a7e7-bdb16006570e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.169638] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 837.169969] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 deletion is rescheduled due to dependency. [ 837.170110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.170432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.170616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.170929] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.171107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.171195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.171424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.171564] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.171722] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.221573] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.221909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.221909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.221980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.222091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.222207] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8129b6d-0cef-4795-92ca-b45484c4f512 is going to be updated. [ 837.267529] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.267742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.267742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.268116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.268116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.269306] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.269451] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.273308] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c665e725-5432-4829-92bd-bd7e5b59f08f with status ACTIVE [ 837.273308] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.273308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.273308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.273308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.273308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.273308] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.273308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.273308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.273308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.273308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.273308] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.273308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.273308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.273834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.273834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.273905] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c665e725-5432-4829-92bd-bd7e5b59f08f is going to be updated. [ 837.284556] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: IN_PROGRESS for 2s [ 837.289563] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb82badc-5a50-4e87-9287-97ed3ba10020',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.290844] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.292460] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.292606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.292683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.292899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.297087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.297418] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.297612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.297690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.297908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.298043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.298144] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb82badc-5a50-4e87-9287-97ed3ba10020 already deleted. [ 837.299291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.299744] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.299859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.299923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.300134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.300276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.300475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c665e725-5432-4829-92bd-bd7e5b59f08f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.406932] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 in Status: SUCCESS [ 837.407196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.407439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.407673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.407930] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.408082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.408148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.408324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.408403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.408485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.408579] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffc805fb-8c1f-41b4-83d2-89346f31ff05',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.675060] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.799949] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.801127] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb82badc-5a50-4e87-9287-97ed3ba10020: rpc.has_security_group_logging(os_id): False [ 837.818143] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.818143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.818143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.818299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.818345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.818594] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.818691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.818752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.818919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.819052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.819151] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb82badc-5a50-4e87-9287-97ed3ba10020 is going to be created. [ 837.835452] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/fb82badc-5a50-4e87-9287-97ed3ba10020], does not exist path=[/infra/domains/default/groups/fb82badc-5a50-4e87-9287-97ed3ba10020]."\n}' [ 837.835644] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb82badc-5a50-4e87-9287-97ed3ba10020 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fb82badc-5a50-4e87-9287-97ed3ba10020 [ 837.835744] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 837.872643] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.872643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.872643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.872643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.874018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.874018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.874018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.874018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.874018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.874018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.874315] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.874315] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.874394] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.874504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.874574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.874658] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb82badc-5a50-4e87-9287-97ed3ba10020 is going to be created. [ 837.889893] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/fb82badc-5a50-4e87-9287-97ed3ba10020], does not exist path=[/infra/domains/default/groups/fb82badc-5a50-4e87-9287-97ed3ba10020]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fb82badc-5a50-4e87-9287-97ed3ba10020 [ 837.889893] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb82badc-5a50-4e87-9287-97ed3ba10020" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.890640] env[69647]: Traceback (most recent call last): [ 837.890640] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 837.890640] env[69647]: return func(*args, **kwargs) [ 837.890640] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 837.890640] env[69647]: res.raise_for_status() [ 837.890640] env[69647]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 837.890640] env[69647]: raise HTTPError(http_error_msg, response=self) [ 837.890640] env[69647]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fb82badc-5a50-4e87-9287-97ed3ba10020 [ 837.890640] env[69647]: During handling of the above exception, another exception occurred: [ 837.890640] env[69647]: Traceback (most recent call last): [ 837.890640] env[69647]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 837.890640] env[69647]: listener.cb(fileno) [ 837.890640] env[69647]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 837.890640] env[69647]: result = function(*args, **kwargs) [ 837.890640] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 837.890640] env[69647]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 837.890640] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 837.890640] env[69647]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 837.890640] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 837.890640] env[69647]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 837.890640] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 837.890640] env[69647]: res.raise_for_status() [ 837.890640] env[69647]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 837.890640] env[69647]: raise HTTPError(http_error_msg, response=self) [ 837.890640] env[69647]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/fb82badc-5a50-4e87-9287-97ed3ba10020 [ 837.890640] env[69647]: Removing descriptor: 13 [ 837.917041] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffc805fb-8c1f-41b4-83d2-89346f31ff05 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.917041] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.917041] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffc805fb-8c1f-41b4-83d2-89346f31ff05 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.917041] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.917041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.918121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.918121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.918121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.918121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.918121] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffc805fb-8c1f-41b4-83d2-89346f31ff05',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.178438] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.304875] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 838.304875] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 838.419196] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffc805fb-8c1f-41b4-83d2-89346f31ff05: rpc.has_security_group_logging(os_id): False [ 838.444805] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.444805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.444805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.444805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.444805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.444805] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.444805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.444805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.444805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.444805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.444805] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.445865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.446957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.449036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.449036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.449036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.449036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.449036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.449036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.449036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.449036] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 is going to be created. [ 838.479075] env[69647]: INFO networking_nsxv3.common.synchronization [None req-aedc4dea-a642-440d-8aa5-b681ae885c99 None None] Enqueued Resource ID: 91643370-ffba-4a16-8d2c-155f34a8cd1b with Priority: HIGHEST for action port [ 838.480508] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91643370-ffba-4a16-8d2c-155f34a8cd1b with Priority: HIGHEST for action port [ 838.480508] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-91643370-ffba-4a16-8d2c-155f34a8cd1b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.480508] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91643370-ffba-4a16-8d2c-155f34a8cd1b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.480686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91643370-ffba-4a16-8d2c-155f34a8cd1b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.481172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91643370-ffba-4a16-8d2c-155f34a8cd1b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.481172] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91643370-ffba-4a16-8d2c-155f34a8cd1b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.519512] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.521319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.521522] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.521964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.522285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.537024] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 in Status: IN_PROGRESS for 2s [ 838.682085] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.682085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.682085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.682085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.682085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.682085] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 838.718252] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.718422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.718466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.718670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.718806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.727476] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 838.984896] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91643370-ffba-4a16-8d2c-155f34a8cd1b [ 838.985175] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.985310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.985377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.985609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.985711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.985806] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91643370-ffba-4a16-8d2c-155f34a8cd1b already deleted. [ 838.985882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91643370-ffba-4a16-8d2c-155f34a8cd1b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.110174] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.110174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.110174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.110174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.127094] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 839.127094] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.127094] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 839.155141] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.155141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.155141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.155141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.164268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.164898] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 839.164937] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 839.165045] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 839.223875] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.224691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.224859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.225522] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.227674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.227919] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 839.294996] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: SUCCESS [ 839.295274] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.295776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.296062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.296280] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.296495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.296576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.296738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.296833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.296915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.297043] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.298290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.298382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.298597] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.298759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.298829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.299038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.299157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.299432] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.305152] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.305152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.305152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.305152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.305152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.305152] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 839.362229] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.362229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.363292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.363833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.364345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.364639] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 839.367329] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'77dd37b2-e31a-46f5-9038-3a77c8bf3df2', 'dea7752c-71a7-48c6-ad69-e6c96549e90c', '37805a80-67ab-4e0f-8bc6-d25e71e20586', '9da9f265-ecd5-4341-a63a-3d1380826075', 'f2e36bcf-78c7-4f7b-8f47-dd80eafb244f', 'df955150-4015-4c07-90e5-0a793c5a1b3b', '7089450c-93b7-4d5b-bc9f-a1a19b5783e0', '6021692f-e8df-461c-b23d-d43cfa61c675', '2c97e0fb-c576-4b45-ad7b-02877e627733', 'b392030a-efbc-48e0-a255-c920f33d1ae4', 'b246b972-14ce-476e-a89c-fdca6030a597', '9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45', '627fe875-c21d-4d02-9ec5-0f012cb64fc1', 'd92e25ad-3d95-4a6f-bb9e-55be52df486a', '3fe058e6-1ee1-46bc-bd88-8e66f89cb196', 'b26cf444-4671-4a90-a2a4-c6ca9787ad9f', '4691b465-a6c4-42d2-86ce-653d3dc9c97e', '80142545-bab7-4367-b0e0-40b8e04f4503', '4bf79df0-b6e9-4d9d-a118-0af87f6e322a', 'c427a432-7eaa-43a9-b426-56f256eb360c', '0c879b90-76f3-430e-8b1f-ba2fe27e511f', 'efccc372-9e22-4eea-9577-4fd80da780f3', 'ffc805fb-8c1f-41b4-83d2-89346f31ff05', '90e6d13e-7877-4688-9ade-504a1a3d2a71', 'ac810154-f096-4495-a2c8-d43e5bb3d1a2', 'cd53af51-8db9-4653-95a6-3f457b519312', '25192273-bc3e-4f3a-9543-1ed380b4ef9b', '11aa9110-c05f-4ee9-95eb-9ace6aec4c6a', 'a9c01b37-5156-42f7-b415-81d83f30f935', '63aea974-cdb8-4b5a-9001-4a1c99d2d349', '9c1ac393-0d0d-48c1-adc3-b358d19ecbca', '92008a16-dbb6-4fa9-bbfd-5faf35617bb1', '690e1872-1ae4-4c49-8159-ec39c82e2868', '7c35014e-8d95-4c20-872d-da537d220b20', '67fa0349-fc9a-4525-98b6-98f14f9e267b', '26d75834-c6a8-4d76-af3a-6cec3f2d79e2', '326bee86-2025-4239-98be-95f9262ac7a3', 'd8129b6d-0cef-4795-92ca-b45484c4f512', '27b912c1-294b-407e-bd8a-c81f04912b02'} {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 839.367329] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 839.386559] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.386559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.386559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.386559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.386559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.386559] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 839.386559] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 839.386559] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 839.449422] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.449591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.449667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.449878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.450680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.450862] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 839.451076] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 839.451175] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 839.451242] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 839.451318] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 839.451386] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 with Priority: HIGH for action security_group_rules [ 839.451463] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dea7752c-71a7-48c6-ad69-e6c96549e90c with Priority: HIGH for action security_group_rules [ 839.451533] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGH for action security_group_rules [ 839.451634] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGH for action security_group_rules [ 839.451703] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f with Priority: HIGH for action security_group_rules [ 839.451762] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGH for action security_group_rules [ 839.451911] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 with Priority: HIGH for action security_group_rules [ 839.451911] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6021692f-e8df-461c-b23d-d43cfa61c675 with Priority: HIGH for action security_group_rules [ 839.452049] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGH for action security_group_rules [ 839.452049] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGH for action security_group_rules [ 839.452103] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b246b972-14ce-476e-a89c-fdca6030a597 with Priority: HIGH for action security_group_rules [ 839.452134] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 with Priority: HIGH for action security_group_rules [ 839.452169] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGH for action security_group_rules [ 839.452226] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGH for action security_group_rules [ 839.452283] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGH for action security_group_rules [ 839.452342] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGH for action security_group_rules [ 839.452400] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGH for action security_group_rules [ 839.452458] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGH for action security_group_rules [ 839.452527] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGH for action security_group_rules [ 839.452614] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGH for action security_group_rules [ 839.452711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.806655] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.806655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.806655] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.309647] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.549135] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 in Status: SUCCESS [ 840.549351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.740309] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 840.740570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.740778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.741277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.741277] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.741445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.741539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.741729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.741876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.741982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.742106] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.813729] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.813729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.813729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.813729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.813729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.813729] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8129b6d-0cef-4795-92ca-b45484c4f512 is going to be updated. [ 840.844610] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.844610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.844610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.844610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.844610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.851445] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: IN_PROGRESS for 2s [ 841.245089] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.245266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.245813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.245813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.245813] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.245991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.245991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.246377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.246377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.246467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.246605] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.246704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.246759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.246905] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.247077] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.247172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.247244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.247506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.247506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.247599] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.247626] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.751335] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 326bee86-2025-4239-98be-95f9262ac7a3: rpc.has_security_group_logging(os_id): False [ 841.768458] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.768600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.768671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.768885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.785689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.785980] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.786115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.786182] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.786394] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.786472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.786681] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.786796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.786860] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.787019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.787096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.787280] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.787373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.787433] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.787569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.787643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.787729] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 841.843623] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.843808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.843869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.844116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.844272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.855000] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 842.284989] env[69647]: INFO networking_nsxv3.common.synchronization [req-715ce9e6-1246-420d-93a9-751ca7ecbbd4 req-639d3b29-6b4e-4d09-b426-d66f9d11f289 tempest-ImagesTestJSON-954996409 tempest-ImagesTestJSON-954996409-project-member] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 842.285535] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 842.285698] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 with Priority: HIGH for action security_group_rules [ 842.285803] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 with Priority: HIGH for action security_group_rules [ 842.285901] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 with Priority: HIGH for action security_group_rules [ 842.286009] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGH for action security_group_rules [ 842.286508] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGH for action security_group_rules [ 842.286508] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGH for action security_group_rules [ 842.286633] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGH for action security_group_rules [ 842.286710] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGH for action security_group_rules [ 842.286808] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGH for action security_group_rules [ 842.286908] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGH for action security_group_rules [ 842.287032] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 with Priority: HIGH for action security_group_rules [ 842.287163] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 with Priority: HIGH for action security_group_rules [ 842.288758] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b246b972-14ce-476e-a89c-fdca6030a597 with Priority: HIGH for action security_group_rules [ 842.288758] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGH for action security_group_rules [ 842.288758] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGH for action security_group_rules [ 842.288758] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df955150-4015-4c07-90e5-0a793c5a1b3b with Priority: HIGH for action security_group_rules [ 842.288758] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6021692f-e8df-461c-b23d-d43cfa61c675 with Priority: HIGH for action security_group_rules [ 842.289053] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f with Priority: HIGH for action security_group_rules [ 842.289053] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea7752c-71a7-48c6-ad69-e6c96549e90c with Priority: HIGH for action security_group_rules [ 842.289053] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGH for action security_group_rules [ 842.289366] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.289504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.289572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.289793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.289957] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.290089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.290141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.290275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.290392] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.290480] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.291369] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77dd37b2-e31a-46f5-9038-3a77c8bf3df2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.291467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.291710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.291710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.291826] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77dd37b2-e31a-46f5-9038-3a77c8bf3df2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.295991] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37805a80-67ab-4e0f-8bc6-d25e71e20586 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.296131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.296199] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.296359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.296447] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37805a80-67ab-4e0f-8bc6-d25e71e20586',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.297325] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7089450c-93b7-4d5b-bc9f-a1a19b5783e0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.297539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.297539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.297873] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.297985] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7089450c-93b7-4d5b-bc9f-a1a19b5783e0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.299065] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.299991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.300129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.300707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.300707] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.301640] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.301744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.301909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.301970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.302075] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.303022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.303143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.303188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.303680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.303680] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.305663] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80142545-bab7-4367-b0e0-40b8e04f4503 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.306298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.306298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.306298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.306298] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.307237] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.307361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.307436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.307588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.307697] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.308575] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.308672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.308736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.308923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.308981] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.313438] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.313563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.313663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.313802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.313894] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.314174] env[69647]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 842.315165] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.315452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.316414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.316414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.316414] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627fe875-c21d-4d02-9ec5-0f012cb64fc1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.317307] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.317433] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.317493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.317680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.317755] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.318720] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b246b972-14ce-476e-a89c-fdca6030a597 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.318783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.318813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.320383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.320383] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b246b972-14ce-476e-a89c-fdca6030a597',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.320590] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b392030a-efbc-48e0-a255-c920f33d1ae4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.320710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.320751] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.320895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.320963] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.321915] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.321992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.322034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.322169] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.322236] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.323114] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df955150-4015-4c07-90e5-0a793c5a1b3b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.323175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.323247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.323394] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.323480] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df955150-4015-4c07-90e5-0a793c5a1b3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.324349] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6021692f-e8df-461c-b23d-d43cfa61c675 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.324566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.324653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.324886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.324886] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6021692f-e8df-461c-b23d-d43cfa61c675',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.327106] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.327106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.327106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.327106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.327106] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2e36bcf-78c7-4f7b-8f47-dd80eafb244f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.327106] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dea7752c-71a7-48c6-ad69-e6c96549e90c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.327106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.327732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.327938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.328022] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dea7752c-71a7-48c6-ad69-e6c96549e90c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.328841] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.328952] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.329025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.329176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.329299] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.329716] env[69647]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 842.360949] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.361134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.361212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.361435] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.388974] env[69647]: INFO networking_nsxv3.common.synchronization [req-61bcb691-f1d2-49d7-babf-8f147dca2d1e req-a70d6a62-a89f-4f35-b302-f2e18c111141 tempest-VolumesAdminNegativeTest-778557798 tempest-VolumesAdminNegativeTest-778557798-project-member] Enqueued Resource ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e with Priority: HIGHEST for action security_group_members [ 842.391180] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e with Priority: HIGHEST for action security_group_members [ 842.393342] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.393458] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37805a80-67ab-4e0f-8bc6-d25e71e20586 is going to be deleted. [ 842.395657] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4ef3a0-bf1a-4fa4-b038-850d2015902e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.396551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.396670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.397622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.397622] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.397877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.397877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.398573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.398573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.398573] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db4ef3a0-bf1a-4fa4-b038-850d2015902e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.448743] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.448743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.448743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.449136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.449188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.449547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37805a80-67ab-4e0f-8bc6-d25e71e20586" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.834127] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.834127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.834127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.834127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.855009] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.855009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.855009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.855009] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.855009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.855009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.855864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.859018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.859018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 842.859018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.859018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.865912] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: SUCCESS [ 842.866291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.866561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.866848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.867153] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.868485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.868485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.868485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.868485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.868485] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.882018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.882018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.882018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.882018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.882018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.884810] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b392030a-efbc-48e0-a255-c920f33d1ae4 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.885220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.886015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.886015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.886015] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.886015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.886015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.886447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.886642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.886836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.887041] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.888016] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-4691b465-a6c4-42d2-86ce-653d3dc9c97e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.888302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.890069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.890069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.890069] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.890069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.890069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.890069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.890069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.890069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.890069] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.899452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.899630] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77dd37b2-e31a-46f5-9038-3a77c8bf3df2 is going to be deleted. [ 842.900635] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d92e25ad-3d95-4a6f-bb9e-55be52df486a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.900785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.900845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.901065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.901631] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.901763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.901837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.902077] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.902180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.902267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.902360] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.903338] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-80142545-bab7-4367-b0e0-40b8e04f4503 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.903460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.903522] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.903662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.903808] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.903912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.903970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.904115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.904232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.904299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.904399] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.907261] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.907639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.907698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.907872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.908041] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.908218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.908218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.908390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.908487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.908583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.908705] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.913219] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.913402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.913402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.913573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.913753] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.913832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.914055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.914055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.914124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.914164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.914297] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.919377] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.919377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.919559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.920356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.920356] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.920356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.920356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.920356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.920356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.921093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.921093] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.922288] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.922407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.922451] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.922638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.922948] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.923066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.923117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.923909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.923909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.923909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.923909] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.927573] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.927699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.928109] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.928327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.928416] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.928683] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.928792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.928851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.929021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.929099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.929184] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e already deleted. [ 842.929268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.930542] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 842.931550] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.931550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.931692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.931883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.937305] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.939342] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.941097] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.970431] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.970885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.971449] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.971558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.975077] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.975205] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dea7752c-71a7-48c6-ad69-e6c96549e90c is going to be deleted. [ 842.976338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.976570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.978489] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.978586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.980114] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.980114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.980230] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.980326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.981036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.981129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.982660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.982778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.983538] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.984206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.984680] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.984755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.003379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.003557] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2e36bcf-78c7-4f7b-8f47-dd80eafb244f is going to be deleted. [ 843.004952] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.005737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.014551] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.014551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.025843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.025843] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be deleted. [ 843.026739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.026917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.039225] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.039225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.081201] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.082606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.084786] env[69647]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 843.085344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.085516] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6021692f-e8df-461c-b23d-d43cfa61c675 is going to be deleted. [ 843.086612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.086875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.116743] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.116937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.125617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.125786] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45 is going to be deleted. [ 843.126838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.127080] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.222313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.222457] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627fe875-c21d-4d02-9ec5-0f012cb64fc1 is going to be deleted. [ 843.223506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.223722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.239296] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.239492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.274628] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.274628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.279156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.279794] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7089450c-93b7-4d5b-bc9f-a1a19b5783e0 is going to be deleted. [ 843.283023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.283023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.359024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.359024] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be deleted. [ 843.359024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.359024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.361260] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.361260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.367614] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.367614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.370715] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.379213] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.379346] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b246b972-14ce-476e-a89c-fdca6030a597 is going to be deleted. [ 843.380668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.380886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.398984] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.410516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.410661] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df955150-4015-4c07-90e5-0a793c5a1b3b is going to be deleted. [ 843.411925] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.413197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.413197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.413197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.413560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77dd37b2-e31a-46f5-9038-3a77c8bf3df2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.413931] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.414156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.414294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.414447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dea7752c-71a7-48c6-ad69-e6c96549e90c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.415256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.415464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.415601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.415753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2e36bcf-78c7-4f7b-8f47-dd80eafb244f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.415985] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.416737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.416941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.417071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.417244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.417605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.417769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.417878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.418023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6021692f-e8df-461c-b23d-d43cfa61c675" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.418219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.418393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.418516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.418708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b2d9b2e-bb5d-4d83-afee-df1b24c3ba45" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.418834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.419012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.419116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.419416] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627fe875-c21d-4d02-9ec5-0f012cb64fc1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.419908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.420290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.420290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.420754] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7089450c-93b7-4d5b-bc9f-a1a19b5783e0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.431255] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.431535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.431535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.431817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.431971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.432123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.439857] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.440870] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.441014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.441082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.441283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.441434] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.441514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.441636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.441795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.441870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.441948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.442110] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.442199] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.442259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.442399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.442532] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.442679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.442679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.442836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.442876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.442942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.443154] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.449617] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d92e25ad-3d95-4a6f-bb9e-55be52df486a: rpc.has_security_group_logging(os_id): False [ 843.450743] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4691b465-a6c4-42d2-86ce-653d3dc9c97e: rpc.has_security_group_logging(os_id): False [ 843.452069] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80142545-bab7-4367-b0e0-40b8e04f4503: rpc.has_security_group_logging(os_id): False [ 843.491712] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.491712] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.491712] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.491712] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.501324] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.501324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.504751] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.504894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.524023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.524023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.527629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.529125] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.529316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.529418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.529741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.530127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.530346] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a is going to be updated. [ 843.534543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.534796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.536588] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.536588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.571091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.571430] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.571940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.571940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.571940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.571940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.572179] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80142545-bab7-4367-b0e0-40b8e04f4503 is going to be updated. [ 843.573844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.574159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.574224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.574487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df955150-4015-4c07-90e5-0a793c5a1b3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.574487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.574590] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.631660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.631994] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.632145] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.632223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.632374] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.632446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.632534] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e is going to be updated. [ 843.633788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.633969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.634076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.634194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b246b972-14ce-476e-a89c-fdca6030a597" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.636999] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.637172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.637247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.637349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.637477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.654226] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a in Status: IN_PROGRESS for 2s [ 843.715746] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.715918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.715981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.716194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.716341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.718307] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.718465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.718525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.718657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.718790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.743027] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e in Status: IN_PROGRESS for 2s [ 843.743753] env[69647]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 843.744392] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80142545-bab7-4367-b0e0-40b8e04f4503 in Status: IN_PROGRESS for 2s [ 843.776750] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.776915] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-309" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.777052] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-309" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.777551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-309" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.778357] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.778357] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.778357] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.778357] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.778357] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.778982] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.778982] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.778982] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.778982] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.779721] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.779721] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.779721] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.801320] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.801501] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.801673] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.801922] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-309" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.802690] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-6b6b0237-bf55-45a2-b592-df4944bd4876 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.802690] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-6b6b0237-bf55-45a2-b592-df4944bd4876" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.802690] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-6b6b0237-bf55-45a2-b592-df4944bd4876" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.805068] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-6b6b0237-bf55-45a2-b592-df4944bd4876" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.805316] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b6b0237-bf55-45a2-b592-df4944bd4876',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.868779] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 843.868779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.873097] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.901063] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b392030a-efbc-48e0-a255-c920f33d1ae4: rpc.has_security_group_logging(os_id): False [ 843.915584] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4bf79df0-b6e9-4d9d-a118-0af87f6e322a: rpc.has_security_group_logging(os_id): False [ 843.918388] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fe058e6-1ee1-46bc-bd88-8e66f89cb196: rpc.has_security_group_logging(os_id): False [ 843.922111] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.922111] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.922111] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.922111] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.942219] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.942219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.945805] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b26cf444-4671-4a90-a2a4-c6ca9787ad9f: rpc.has_security_group_logging(os_id): False [ 843.945805] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c97e0fb-c576-4b45-ad7b-02877e627733: rpc.has_security_group_logging(os_id): False [ 843.948629] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.948629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.959511] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.959842] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.959946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.960027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.960207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.960286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.960395] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b392030a-efbc-48e0-a255-c920f33d1ae4 is going to be updated. [ 843.961496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.961702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.969079] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.969079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.971311] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.971426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.981251] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.981578] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.981682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.981739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.981987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.982038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.985304] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a is going to be updated. [ 843.985304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.985304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.013603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.013945] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.014233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.014233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.014330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.014393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.014485] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 is going to be updated. [ 844.016073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.016271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.021838] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.021955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.039391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.039391] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.039391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.039391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.039391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.039391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.039391] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f is going to be updated. [ 844.039391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.039391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.051456] env[69647]: INFO networking_nsxv3.common.synchronization [req-a08cb765-b356-4a1c-a8a8-bfc86aa3d089 req-2090eb7d-f61a-4d07-b46f-ea2c18ea70a4 tempest-ServerRescueTestJSONUnderV235-1656230026 tempest-ServerRescueTestJSONUnderV235-1656230026-project-member] Enqueued Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 844.052059] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8129b6d-0cef-4795-92ca-b45484c4f512 with Priority: HIGHEST for action security_group_members [ 844.053348] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.053486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.077487] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.077487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.090896] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.091108] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.091268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.091340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.092229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.092229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.092229] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.092229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.092229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.092628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.092628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.092697] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.092742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.092804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.092981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.093114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.093245] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 is going to be updated. [ 844.097353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.097353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.097353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.097353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.097664] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.097692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.117070] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b392030a-efbc-48e0-a255-c920f33d1ae4 in Status: IN_PROGRESS for 2s [ 844.117070] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a in Status: IN_PROGRESS for 2s [ 844.139840] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.139983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.140063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.140918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.140918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.159877] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.160046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.160123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.160352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.160908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.215408] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: IN_PROGRESS for 2s [ 844.225458] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: IN_PROGRESS for 2s [ 844.264361] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.264361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.264361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.264361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.264361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.296154] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: IN_PROGRESS for 2s [ 844.311014] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.311202] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.311410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.311768] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.312011] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.312238] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 6b6b0237-bf55-45a2-b592-df4944bd4876 not found, creating... [ 844.312612] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.312852] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.313050] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.313355] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.313541] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.313937] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.315071] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.315303] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.315466] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.315608] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.315869] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 6b6b0237-bf55-45a2-b592-df4944bd4876 is going to be created. [ 844.338720] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.338720] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.338720] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.339904] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.339904] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.339904] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-6b6b0237-bf55-45a2-b592-df4944bd4876" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.375658] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.375783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.375870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.376110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.376205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.376311] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8129b6d-0cef-4795-92ca-b45484c4f512 is going to be updated. [ 844.420242] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.420242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.420242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.420621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.420621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.438542] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: IN_PROGRESS for 2s [ 844.477784] env[69647]: INFO networking_nsxv3.common.synchronization [None req-e26a2912-690b-4fa1-9494-0f18515a08dc None None] Enqueued Resource ID: 7a1a8b14-68a6-4db6-ba1f-a6fa36a3bfa9 with Priority: HIGHEST for action port [ 844.477989] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a1a8b14-68a6-4db6-ba1f-a6fa36a3bfa9 with Priority: HIGHEST for action port [ 844.478368] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a1a8b14-68a6-4db6-ba1f-a6fa36a3bfa9 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.478478] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a1a8b14-68a6-4db6-ba1f-a6fa36a3bfa9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.478549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a1a8b14-68a6-4db6-ba1f-a6fa36a3bfa9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.478816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a1a8b14-68a6-4db6-ba1f-a6fa36a3bfa9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.478892] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a1a8b14-68a6-4db6-ba1f-a6fa36a3bfa9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.752481] env[69647]: INFO networking_nsxv3.common.synchronization [None req-4f3aea6b-3fd2-4855-9c8b-107149059c28 None None] Enqueued Resource ID: bc314448-04ee-4711-a6d6-f3585f173609 with Priority: HIGHEST for action port [ 844.753565] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc314448-04ee-4711-a6d6-f3585f173609 with Priority: HIGHEST for action port [ 844.753565] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc314448-04ee-4711-a6d6-f3585f173609 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.753565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc314448-04ee-4711-a6d6-f3585f173609" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.753565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc314448-04ee-4711-a6d6-f3585f173609" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.753937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc314448-04ee-4711-a6d6-f3585f173609" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.753937] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc314448-04ee-4711-a6d6-f3585f173609',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.819989] env[69647]: INFO networking_nsxv3.common.synchronization [req-66873fdb-006c-4cc3-9521-61186401092f req-889388d0-2304-45e3-8102-b522d7f4b843 tempest-ServersTestMultiNic-870967946 tempest-ServersTestMultiNic-870967946-project-member] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 844.820535] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 844.820836] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.820960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.821089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.821299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.821455] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.821580] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.821648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.821800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.821885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.821980] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.940211] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 844.940211] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 deletion is rescheduled due to dependency. [ 844.940211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.982671] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a1a8b14-68a6-4db6-ba1f-a6fa36a3bfa9 [ 844.982671] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.982671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.982671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.982671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.982671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.982671] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a1a8b14-68a6-4db6-ba1f-a6fa36a3bfa9 already deleted. [ 844.982671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a1a8b14-68a6-4db6-ba1f-a6fa36a3bfa9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.060231] env[69647]: INFO networking_nsxv3.common.synchronization [req-a1025ce8-35cb-4f71-9720-6098d75217d6 req-e9de3f73-1637-4e57-841f-98251d23c3cc tempest-ServerAddressesTestJSON-1237503775 tempest-ServerAddressesTestJSON-1237503775-project-member] Enqueued Resource ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 with Priority: HIGHEST for action security_group_members [ 845.060765] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 with Priority: HIGHEST for action security_group_members [ 845.061610] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffc805fb-8c1f-41b4-83d2-89346f31ff05 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.061610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.061610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.061610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.061610] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.061951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.061951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.061951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.062052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.064379] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffc805fb-8c1f-41b4-83d2-89346f31ff05',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.261505] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc314448-04ee-4711-a6d6-f3585f173609 [ 845.261505] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.261505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.261505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.261505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.261505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.261505] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc314448-04ee-4711-a6d6-f3585f173609 already deleted. [ 845.261505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc314448-04ee-4711-a6d6-f3585f173609" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.329477] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.329477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.329477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.329477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.329477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.329793] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.329793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.329919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.329964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.330033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.330122] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be deleted. [ 845.362704] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.362704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.362704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.362704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.362881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.362881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.566902] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.568673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.568673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.568673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.588970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.588970] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.588970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.588970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.588970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.588970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.588970] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 is going to be updated. [ 845.613162] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.613162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.613162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.613162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.613162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.625512] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 in Status: IN_PROGRESS for 2s [ 845.668715] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a in Status: SUCCESS [ 845.668715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.758663] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80142545-bab7-4367-b0e0-40b8e04f4503 in Status: SUCCESS [ 845.758921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.760298] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e in Status: SUCCESS [ 845.760452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.830811] env[69647]: INFO networking_nsxv3.common.synchronization [req-61bcb691-f1d2-49d7-babf-8f147dca2d1e req-795bcd3e-1fc4-4ad1-8821-0bb826f67599 service nova] Enqueued Resource ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e with Priority: HIGHEST for action security_group_rules [ 845.831072] env[69647]: INFO networking_nsxv3.common.synchronization [req-61bcb691-f1d2-49d7-babf-8f147dca2d1e req-795bcd3e-1fc4-4ad1-8821-0bb826f67599 service nova] Enqueued Resource ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e with Priority: HIGHEST for action security_group_members [ 845.831256] env[69647]: INFO networking_nsxv3.common.synchronization [req-61bcb691-f1d2-49d7-babf-8f147dca2d1e req-795bcd3e-1fc4-4ad1-8821-0bb826f67599 service nova] Enqueued Resource ID: 6b6b0237-bf55-45a2-b592-df4944bd4876 with Priority: HIGHEST for action port [ 845.832285] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e with Priority: HIGHEST for action security_group_rules [ 845.832464] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e with Priority: HIGHEST for action security_group_members [ 845.832665] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b6b0237-bf55-45a2-b592-df4944bd4876 with Priority: HIGHEST for action port [ 845.832942] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db4ef3a0-bf1a-4fa4-b038-850d2015902e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.833128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.833215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.833493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.833751] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db4ef3a0-bf1a-4fa4-b038-850d2015902e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.834997] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4ef3a0-bf1a-4fa4-b038-850d2015902e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.835292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.835292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.835529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.835705] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.835833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.835915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.836241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.836392] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.836516] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db4ef3a0-bf1a-4fa4-b038-850d2015902e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.837322] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b6b0237-bf55-45a2-b592-df4944bd4876 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.837672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b6b0237-bf55-45a2-b592-df4944bd4876" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.837825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b6b0237-bf55-45a2-b592-df4944bd4876" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.837982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b6b0237-bf55-45a2-b592-df4944bd4876" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.838040] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b6b0237-bf55-45a2-b592-df4944bd4876',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.875605] env[69647]: INFO networking_nsxv3.common.synchronization [req-66873fdb-006c-4cc3-9521-61186401092f req-4b3d2997-da35-4fbe-9342-508bccb49f3e tempest-ServersTestMultiNic-870967946 tempest-ServersTestMultiNic-870967946-project-member] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 845.876105] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 845.876411] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.876549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.876597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.876789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.876938] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.877780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.879037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.879037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.879037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.879037] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.139903] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a in Status: SUCCESS [ 846.139903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.140310] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b392030a-efbc-48e0-a255-c920f33d1ae4 in Status: SUCCESS [ 846.140310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.229581] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: SUCCESS [ 846.229987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.236338] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: SUCCESS [ 846.236609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.307461] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: SUCCESS [ 846.307677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.336333] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4ef3a0-bf1a-4fa4-b038-850d2015902e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.336496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.339923] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b6b0237-bf55-45a2-b592-df4944bd4876 with status ACTIVE [ 846.340147] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.340300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.340379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.340587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.340685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.340866] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.340973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.341035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.341227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.341292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.341433] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.341701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.341770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.341943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.342037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.342119] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b6b0237-bf55-45a2-b592-df4944bd4876 is going to be updated. [ 846.343406] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db4ef3a0-bf1a-4fa4-b038-850d2015902e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.362669] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.362820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.362861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.363296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.363296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.363460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b6b0237-bf55-45a2-b592-df4944bd4876" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.385276] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.385276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.385276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.385276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.385276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.385276] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.385484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.385484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.385693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.385820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.385950] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c already deleted. [ 846.386099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.453697] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: SUCCESS [ 846.453697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.453883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.454492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.454492] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.454492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.454805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.454805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.454805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.454967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.455034] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8129b6d-0cef-4795-92ca-b45484c4f512 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.455104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.455184] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.455365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.455807] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.455807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.455807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.455996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.455996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.459940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.460219] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.461234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.463178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.463178] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.463316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.463434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.463535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.463587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.463685] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.726340] env[69647]: INFO networking_nsxv3.common.synchronization [None req-689203bb-2064-4a34-83f9-097a2793e3e8 None None] Enqueued Resource ID: 10ba4aa8-32c0-4d81-90ac-7243f45fd36e with Priority: HIGHEST for action port [ 846.729510] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ba4aa8-32c0-4d81-90ac-7243f45fd36e with Priority: HIGHEST for action port [ 846.729510] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-10ba4aa8-32c0-4d81-90ac-7243f45fd36e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.729510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10ba4aa8-32c0-4d81-90ac-7243f45fd36e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.729510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10ba4aa8-32c0-4d81-90ac-7243f45fd36e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.729510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10ba4aa8-32c0-4d81-90ac-7243f45fd36e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.729510] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10ba4aa8-32c0-4d81-90ac-7243f45fd36e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.847903] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db4ef3a0-bf1a-4fa4-b038-850d2015902e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.969079] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.972018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.972018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.972018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.972018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8129b6d-0cef-4795-92ca-b45484c4f512: rpc.has_security_group_logging(os_id): False [ 846.988694] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.988694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.990406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.990531] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.990943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.990943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.990943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.991078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.991078] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8129b6d-0cef-4795-92ca-b45484c4f512 is going to be updated. [ 846.992307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.992307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.992307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.992528] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.992626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.992685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.992840] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.992913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.993161] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.993257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.993315] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.993622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.993721] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.993902] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.993993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.994104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.994266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.994338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.994419] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8129b6d-0cef-4795-92ca-b45484c4f512 is going to be updated. [ 847.022406] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.022584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.022650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.022817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.022954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.032065] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: IN_PROGRESS for 2s [ 847.067426] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.067609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.067640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.067849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.067994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.072574] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.072821] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-293" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.072996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-293" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.073369] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-293" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.073747] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.077007] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.077007] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.077007] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.077007] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.077007] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.077007] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.077007] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.077007] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.077007] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.077007] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.077007] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.084576] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: IN_PROGRESS for 2s [ 847.097220] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.097220] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 847.097220] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.097220] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-293" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.097220] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.097220] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.097220] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.097220] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.097220] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.120772] env[69647]: INFO networking_nsxv3.common.synchronization [None req-72589922-6745-496e-8d7c-c7d168ff3a31 None None] Enqueued Resource ID: a59a05ad-9dc7-4a9f-83b5-462ddca1c39e with Priority: HIGHEST for action port [ 847.121816] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59a05ad-9dc7-4a9f-83b5-462ddca1c39e with Priority: HIGHEST for action port [ 847.121816] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a59a05ad-9dc7-4a9f-83b5-462ddca1c39e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.121816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a59a05ad-9dc7-4a9f-83b5-462ddca1c39e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.122017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a59a05ad-9dc7-4a9f-83b5-462ddca1c39e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.122297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a59a05ad-9dc7-4a9f-83b5-462ddca1c39e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.122297] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a59a05ad-9dc7-4a9f-83b5-462ddca1c39e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.230068] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10ba4aa8-32c0-4d81-90ac-7243f45fd36e [ 847.230344] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.230448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.230507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.230710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.230792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.230885] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10ba4aa8-32c0-4d81-90ac-7243f45fd36e already deleted. [ 847.230962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10ba4aa8-32c0-4d81-90ac-7243f45fd36e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.352964] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.353535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.353535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.353535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.353535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.353702] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e is going to be created. [ 847.376065] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.376581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.376783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.377245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.377529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.391109] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e in Status: UNINITIALIZED for 2s [ 847.600806] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.601085] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.601230] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.601461] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.601695] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.601866] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4 not found, creating... [ 847.602149] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.602316] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.602586] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.603338] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.603338] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.603338] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.603712] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.603712] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.603806] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.604038] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.604356] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4 is going to be created. [ 847.623573] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.623918] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.624033] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.624525] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.624525] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.624751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.626743] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a59a05ad-9dc7-4a9f-83b5-462ddca1c39e [ 847.626996] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.627134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.627187] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.627357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.627434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.627550] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a59a05ad-9dc7-4a9f-83b5-462ddca1c39e already deleted. [ 847.627588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a59a05ad-9dc7-4a9f-83b5-462ddca1c39e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.637111] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 in Status: SUCCESS [ 847.637111] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 deletion is rescheduled due to dependency. [ 847.637111] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.158344] env[69647]: INFO networking_nsxv3.common.synchronization [req-5c3b4aa0-b1f9-495b-bb8c-20d7486cb0e7 req-b5e4a3a1-53ee-4973-8b8e-7c227a07f3b9 tempest-ServersWithSpecificFlavorTestJSON-1052584011 tempest-ServersWithSpecificFlavorTestJSON-1052584011-project-member] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 848.310176] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 848.311101] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.311101] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.311101] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.311449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.311449] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.311449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.311449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.311867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.311867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.311867] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.550429] env[69647]: INFO networking_nsxv3.common.synchronization [req-66873fdb-006c-4cc3-9521-61186401092f req-07a00b2d-8a5f-4325-98bb-fc85ccfaa654 service nova] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_rules [ 848.550429] env[69647]: INFO networking_nsxv3.common.synchronization [req-66873fdb-006c-4cc3-9521-61186401092f req-07a00b2d-8a5f-4325-98bb-fc85ccfaa654 service nova] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 848.550429] env[69647]: INFO networking_nsxv3.common.synchronization [req-66873fdb-006c-4cc3-9521-61186401092f req-07a00b2d-8a5f-4325-98bb-fc85ccfaa654 service nova] Enqueued Resource ID: c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4 with Priority: HIGHEST for action port [ 848.553305] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_rules [ 848.553454] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 848.553550] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4 with Priority: HIGHEST for action port [ 848.554197] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.554355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.554387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.554613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.554691] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.555573] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.555701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.555732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.555892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.556043] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.556132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.556189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.556368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.556409] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.556489] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.561201] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.561333] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.561462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.561581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.561671] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.814408] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.814573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.814685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.814856] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.814949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.815162] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.815258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.815314] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.815460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.815532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.815624] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f is going to be updated. [ 848.852297] env[69647]: INFO networking_nsxv3.common.synchronization [None req-39f6d216-d003-4ca7-8ddc-f83be93d2a62 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_rules [ 848.853544] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_rules [ 848.853544] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.853544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.853544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.853922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.853922] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bd6af1f-0d53-486d-ac51-c6ef7bb925cc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.861706] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.861824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.861824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.862219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.862219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.870355] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: IN_PROGRESS for 2s [ 849.041920] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: SUCCESS [ 849.041920] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8129b6d-0cef-4795-92ca-b45484c4f512 deletion is rescheduled due to dependency. [ 849.041920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.061272] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.063366] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4 with status ACTIVE [ 849.063741] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.064015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.064194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.064507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.064692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.064962] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.065185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.065332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.065573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.065742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.066028] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.066253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.067018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.067018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.067018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.067018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4 is going to be updated. [ 849.068123] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.068353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.088317] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.088317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.088317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.088317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.088317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.088317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9faae37-9cc4-4e9a-a1be-9fcc96e5ebb4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.101501] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8129b6d-0cef-4795-92ca-b45484c4f512 in Status: SUCCESS [ 849.101501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.101501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.101501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.101501] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8129b6d-0cef-4795-92ca-b45484c4f512',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.123174] env[69647]: INFO networking_nsxv3.common.synchronization [None req-f4047d02-7302-49a7-bd3f-9655e5ae4dca tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_rules [ 849.123920] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_rules [ 849.124377] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.125139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.366249] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-347 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.366249] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-347" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.366249] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-347" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.366249] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-347" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.366249] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.366643] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.366643] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.366705] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.367571] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.367571] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.367571] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.367571] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.367571] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.367806] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.367950] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.368263] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.372335] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.372335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.372478] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.372823] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.373143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.373279] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc already deleted. [ 849.373402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.373834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.374271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.374426] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bd6af1f-0d53-486d-ac51-c6ef7bb925cc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.385595] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.385782] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 849.385934] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.386139] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-347" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.386455] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-7647abd3-6cdd-459a-a5e8-a8300380cda8 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.386641] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-7647abd3-6cdd-459a-a5e8-a8300380cda8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.386765] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-7647abd3-6cdd-459a-a5e8-a8300380cda8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.387113] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-7647abd3-6cdd-459a-a5e8-a8300380cda8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.387258] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7647abd3-6cdd-459a-a5e8-a8300380cda8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.401800] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e in Status: SUCCESS [ 849.402668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.402954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.403218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.403407] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.403516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.403578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.403724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.403800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.403888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.403995] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db4ef3a0-bf1a-4fa4-b038-850d2015902e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.563856] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.619626] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.619783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.619865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.620188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.620301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.620421] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8129b6d-0cef-4795-92ca-b45484c4f512 is going to be deleted. [ 849.670764] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.671143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.671143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.671276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.671321] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.671425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8129b6d-0cef-4795-92ca-b45484c4f512" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.797691] env[69647]: INFO networking_nsxv3.common.synchronization [req-8f9ff215-71f3-40cf-9a6f-20bafa593dcb req-fedd9f13-16be-4cc9-9188-50c57ce79480 tempest-ServersAdminTestJSON-1923625429 tempest-ServersAdminTestJSON-1923625429-project-member] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 849.798331] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 849.798639] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.802215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.802298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.802487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.802652] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.802757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.802837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.803017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.803108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.803203] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.896219] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.896385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.896543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.896816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.896945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.897070] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc already deleted. [ 849.897175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.897851] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.898121] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.898258] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.898529] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.898620] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.898766] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 7647abd3-6cdd-459a-a5e8-a8300380cda8 not found, creating... [ 849.902532] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.902817] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.902955] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.903242] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.903364] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.903673] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.903838] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.903958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.904184] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.904329] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.904460] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 7647abd3-6cdd-459a-a5e8-a8300380cda8 is going to be created. [ 849.908277] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4ef3a0-bf1a-4fa4-b038-850d2015902e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.908405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.908482] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.908633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.908782] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.908878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.908940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.909098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.909175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.909259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.911624] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4ef3a0-bf1a-4fa4-b038-850d2015902e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.911772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.911893] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.912093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.912258] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.912415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.912500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.912662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.912728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.912828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.912987] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db4ef3a0-bf1a-4fa4-b038-850d2015902e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.931441] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.931682] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.931818] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.932822] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.933145] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.933391] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-7647abd3-6cdd-459a-a5e8-a8300380cda8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.070863] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.071031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.071110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.071327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.071415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.071519] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be created. [ 850.099353] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.099497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.099558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.099762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.099919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.113245] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: UNINITIALIZED for 2s [ 850.305441] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.415324] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db4ef3a0-bf1a-4fa4-b038-850d2015902e: rpc.has_security_group_logging(os_id): False [ 850.432968] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.433162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.433162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.433406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.433490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.433741] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.433928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.433928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.434173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.434233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.434431] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.434561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.434561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.434769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.434843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.435224] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.435355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.435479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.435689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.435840] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.436017] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e is going to be created. [ 850.496316] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.496483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.496554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.496824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.497042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.507419] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e in Status: IN_PROGRESS for 2s [ 850.623235] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-593 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.624254] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.624436] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.624811] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.625160] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.625377] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.625503] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.625734] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.625876] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.626116] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.626261] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.626334] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.626441] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.626549] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.626670] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.626790] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.664292] env[69647]: INFO networking_nsxv3.common.synchronization [req-66873fdb-006c-4cc3-9521-61186401092f req-a3407d98-6807-4b38-8be2-9ea804c47e4f service nova] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_rules [ 850.664292] env[69647]: INFO networking_nsxv3.common.synchronization [req-66873fdb-006c-4cc3-9521-61186401092f req-a3407d98-6807-4b38-8be2-9ea804c47e4f service nova] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 850.664292] env[69647]: INFO networking_nsxv3.common.synchronization [req-66873fdb-006c-4cc3-9521-61186401092f req-a3407d98-6807-4b38-8be2-9ea804c47e4f service nova] Enqueued Resource ID: 7647abd3-6cdd-459a-a5e8-a8300380cda8 with Priority: HIGHEST for action port [ 850.665777] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_rules [ 850.667689] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 850.667882] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7647abd3-6cdd-459a-a5e8-a8300380cda8 with Priority: HIGHEST for action port [ 850.669103] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.673996] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 850.673996] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.673996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-593" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.673996] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1667d59d-0f3e-4a56-8499-1963241be3ab taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.673996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1667d59d-0f3e-4a56-8499-1963241be3ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.673996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1667d59d-0f3e-4a56-8499-1963241be3ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.673996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1667d59d-0f3e-4a56-8499-1963241be3ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.673996] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1667d59d-0f3e-4a56-8499-1963241be3ab',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.673996] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.673996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.674434] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.674434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.674720] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-7647abd3-6cdd-459a-a5e8-a8300380cda8 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.675273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7647abd3-6cdd-459a-a5e8-a8300380cda8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.675462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7647abd3-6cdd-459a-a5e8-a8300380cda8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.675784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7647abd3-6cdd-459a-a5e8-a8300380cda8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.675919] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7647abd3-6cdd-459a-a5e8-a8300380cda8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.809173] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.879788] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: SUCCESS [ 850.879788] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f deletion is rescheduled due to dependency. [ 850.879788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.179173] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.180596] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.180596] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.180596] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.180596] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.180596] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1667d59d-0f3e-4a56-8499-1963241be3ab not found, creating... [ 851.180908] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.182026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.182026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.182026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.182026] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.182026] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.182248] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.182346] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.183258] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.183258] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.183258] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1667d59d-0f3e-4a56-8499-1963241be3ab is going to be created. [ 851.184460] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7647abd3-6cdd-459a-a5e8-a8300380cda8 with status ACTIVE [ 851.184460] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.184460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.184460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.184726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.184726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.184726] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.184855] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.184855] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.185147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.185147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.185269] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.185344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.185391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.185499] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.185569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.185649] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7647abd3-6cdd-459a-a5e8-a8300380cda8 is going to be updated. [ 851.230175] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.230427] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.230560] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.230845] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.231117] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.231316] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1667d59d-0f3e-4a56-8499-1963241be3ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.232969] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.233234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.233307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.233480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.233605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.233753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7647abd3-6cdd-459a-a5e8-a8300380cda8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.310763] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.310939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.311017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.311239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.311330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.311438] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 851.356642] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.356642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.356642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.356642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.356642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.365332] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 851.942629] env[69647]: INFO networking_nsxv3.common.synchronization [req-f06f3028-2168-44a6-99b3-2244b6f5a50c req-c75d52fd-3f60-40b4-a1de-8a404796205a tempest-MultipleCreateTestJSON-207473124 tempest-MultipleCreateTestJSON-207473124-project-member] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 851.943183] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 851.943489] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.943609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.943676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.943950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.944518] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.944631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.944700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.944860] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.944944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.945095] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.122111] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 852.122354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.122498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.122744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.122942] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.123072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.123154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.123296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.123365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.123449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.123546] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.124400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.124570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.124727] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.124959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.125041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.125194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.125272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.125361] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.238429] env[69647]: INFO networking_nsxv3.common.synchronization [req-8f9ff215-71f3-40cf-9a6f-20bafa593dcb req-a6018692-0870-48b7-817f-9c44d4c362ae service nova] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_rules [ 852.238429] env[69647]: INFO networking_nsxv3.common.synchronization [req-8f9ff215-71f3-40cf-9a6f-20bafa593dcb req-a6018692-0870-48b7-817f-9c44d4c362ae service nova] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 852.238429] env[69647]: INFO networking_nsxv3.common.synchronization [req-8f9ff215-71f3-40cf-9a6f-20bafa593dcb req-a6018692-0870-48b7-817f-9c44d4c362ae service nova] Enqueued Resource ID: 1667d59d-0f3e-4a56-8499-1963241be3ab with Priority: HIGHEST for action port [ 852.238429] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_rules [ 852.244495] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 852.244495] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1667d59d-0f3e-4a56-8499-1963241be3ab with Priority: HIGHEST for action port [ 852.244495] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.244495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.244495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.244495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.244495] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.244495] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.244495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.246090] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1667d59d-0f3e-4a56-8499-1963241be3ab taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.246419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1667d59d-0f3e-4a56-8499-1963241be3ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.248427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1667d59d-0f3e-4a56-8499-1963241be3ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.248427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1667d59d-0f3e-4a56-8499-1963241be3ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.248427] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1667d59d-0f3e-4a56-8499-1963241be3ab',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.321631] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.321910] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.322107] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.322491] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.322849] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.323061] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.323224] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.323509] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.323720] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.324119] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.324294] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.324441] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.324583] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.324752] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.324961] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.325139] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.354180] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.354753] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 852.354753] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.354753] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.355043] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-5f155a0b-b388-41b0-abcc-043741a94b02 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.355209] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-5f155a0b-b388-41b0-abcc-043741a94b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.355329] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-5f155a0b-b388-41b0-abcc-043741a94b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.355665] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-5f155a0b-b388-41b0-abcc-043741a94b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.358985] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f155a0b-b388-41b0-abcc-043741a94b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.449816] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.449816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.449999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.450990] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.450990] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.450990] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.450990] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.450990] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.451278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.451713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.451713] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 already deleted. [ 852.451713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.523678] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e in Status: SUCCESS [ 852.523678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.629160] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.629160] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.629160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.749293] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.749475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.751964] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1667d59d-0f3e-4a56-8499-1963241be3ab with status ACTIVE [ 852.756028] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.756028] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.756028] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.756028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.756028] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1667d59d-0f3e-4a56-8499-1963241be3ab is going to be updated. [ 852.775388] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.775560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.775628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.775869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.776834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.777014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1667d59d-0f3e-4a56-8499-1963241be3ab" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.863014] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.863307] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.863498] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.863861] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.864086] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.864292] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 5f155a0b-b388-41b0-abcc-043741a94b02 not found, creating... [ 852.864686] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.864961] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.868939] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.868939] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.868939] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.868939] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.868939] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.868939] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.868939] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.868939] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.868939] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 5f155a0b-b388-41b0-abcc-043741a94b02 is going to be created. [ 852.891136] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.891136] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.891136] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.891565] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.891923] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.893296] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-5f155a0b-b388-41b0-abcc-043741a94b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.137123] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.377070] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 853.377336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.377532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.380285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.380556] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.380713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.380713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.381653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.381653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.381653] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.589101] env[69647]: INFO networking_nsxv3.common.synchronization [req-f06f3028-2168-44a6-99b3-2244b6f5a50c req-f82783b3-e5c6-4f0e-8e9e-06b3aea3233a service nova] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_rules [ 853.589101] env[69647]: INFO networking_nsxv3.common.synchronization [req-f06f3028-2168-44a6-99b3-2244b6f5a50c req-f82783b3-e5c6-4f0e-8e9e-06b3aea3233a service nova] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 853.589408] env[69647]: INFO networking_nsxv3.common.synchronization [req-f06f3028-2168-44a6-99b3-2244b6f5a50c req-f82783b3-e5c6-4f0e-8e9e-06b3aea3233a service nova] Enqueued Resource ID: 5f155a0b-b388-41b0-abcc-043741a94b02 with Priority: HIGHEST for action port [ 853.589678] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_rules [ 853.589825] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 853.589899] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f155a0b-b388-41b0-abcc-043741a94b02 with Priority: HIGHEST for action port [ 853.591101] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.591229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.591293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.591583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.591696] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.592532] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.592648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.592737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.592907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.593068] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.593164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.593222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.593397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.593476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.593517] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.594294] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f155a0b-b388-41b0-abcc-043741a94b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.594402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f155a0b-b388-41b0-abcc-043741a94b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.594471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f155a0b-b388-41b0-abcc-043741a94b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.594616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f155a0b-b388-41b0-abcc-043741a94b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.594690] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f155a0b-b388-41b0-abcc-043741a94b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.639910] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.639910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.640653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.640653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.640653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.640653] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be updated. [ 853.667371] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.667575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.667657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.667869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.668049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.676626] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 853.883712] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.096629] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.096823] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.096933] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.098098] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f155a0b-b388-41b0-abcc-043741a94b02 with status ACTIVE [ 854.098204] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.098310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.098363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.098610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.098610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.098820] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.098921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.098990] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.099125] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.099282] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.099432] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.099622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.099622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.099751] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.099780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.099868] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f155a0b-b388-41b0-abcc-043741a94b02 is going to be updated. [ 854.123368] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.123492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.123607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.123811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.123976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.124164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f155a0b-b388-41b0-abcc-043741a94b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.386668] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.603995] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.759663] env[69647]: INFO networking_nsxv3.common.synchronization [req-ef6e9821-0bd8-491e-b213-ebe06ca0a2be req-2b18ae2b-dd76-4b05-a7bc-ec56f908d55f tempest-VolumesAssistedSnapshotsTest-1240742357 tempest-VolumesAssistedSnapshotsTest-1240742357-project-member] Enqueued Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_members [ 854.760271] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGHEST for action security_group_members [ 854.760605] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b392030a-efbc-48e0-a255-c920f33d1ae4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.760732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.760800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.760996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.766279] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.766429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.766479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.767156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.767258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.767366] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.891799] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.891799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.891799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.891799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.891799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.891799] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 854.903625] env[69647]: INFO networking_nsxv3.common.synchronization [req-f06f3028-2168-44a6-99b3-2244b6f5a50c req-08811294-7937-463e-8f79-434aecf795a8 tempest-MultipleCreateTestJSON-207473124 tempest-MultipleCreateTestJSON-207473124-project-member] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 854.904533] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 854.904533] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.904624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.922025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.922025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.922025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.922025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.922025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.937568] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 855.105102] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.105627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.105758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.106127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.106423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.106592] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be created. [ 855.129526] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.129765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.129878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.130148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.130367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.139753] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: UNINITIALIZED for 2s [ 855.270090] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.270239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.270506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.270806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.270915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.271161] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.271285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.271361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.271537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.271647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.271751] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b392030a-efbc-48e0-a255-c920f33d1ae4 is going to be updated. [ 855.296542] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.296685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.296744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.297363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.297363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.305074] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b392030a-efbc-48e0-a255-c920f33d1ae4 in Status: IN_PROGRESS for 2s [ 855.317643] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.317803] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.317927] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.318222] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.318490] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.318652] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.318787] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.321297] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.321506] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.321783] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 855.322358] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.322358] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.322358] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.322358] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 855.322840] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.322840] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.339830] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.340099] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 855.340193] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.340385] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.340729] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-0a5218bc-2d51-42ac-81e7-57363b82a399 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.340922] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-0a5218bc-2d51-42ac-81e7-57363b82a399" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.341081] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-0a5218bc-2d51-42ac-81e7-57363b82a399" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.341412] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-0a5218bc-2d51-42ac-81e7-57363b82a399" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.341675] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a5218bc-2d51-42ac-81e7-57363b82a399',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.686459] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 855.686758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.686758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.687032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.687249] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.687389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.687498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.687654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.688996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.688996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.688996] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.688996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.688996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.688996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.688996] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.688996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.688996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.688996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.688996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.688996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.689579] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.845476] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.845698] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.845828] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.846151] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.846304] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.849212] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 0a5218bc-2d51-42ac-81e7-57363b82a399 not found, creating... [ 855.849212] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.849212] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.849212] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.849212] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.849212] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.849212] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.849212] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.849212] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.849212] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.850431] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.850431] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 0a5218bc-2d51-42ac-81e7-57363b82a399 is going to be created. [ 855.869214] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.869473] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.869704] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.869899] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.870105] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.870333] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-0a5218bc-2d51-42ac-81e7-57363b82a399" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.193115] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c427a432-7eaa-43a9-b426-56f256eb360c: rpc.has_security_group_logging(os_id): False [ 856.217015] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.217244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.217340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.217649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.217787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.218132] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.218294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.218390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.218564] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.218646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.218841] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.219358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.219358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.219358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.219485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.219594] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.219682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.219745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.219885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.220048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.220102] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be created. [ 856.290815] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.290935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.291038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.291261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.291446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.302521] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 856.827591] env[69647]: INFO networking_nsxv3.common.synchronization [req-f06f3028-2168-44a6-99b3-2244b6f5a50c req-78081244-93ee-4a33-a2e8-f8c6f0ff3ca9 service nova] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_rules [ 856.827874] env[69647]: INFO networking_nsxv3.common.synchronization [req-f06f3028-2168-44a6-99b3-2244b6f5a50c req-78081244-93ee-4a33-a2e8-f8c6f0ff3ca9 service nova] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 856.827933] env[69647]: INFO networking_nsxv3.common.synchronization [req-f06f3028-2168-44a6-99b3-2244b6f5a50c req-78081244-93ee-4a33-a2e8-f8c6f0ff3ca9 service nova] Enqueued Resource ID: 0a5218bc-2d51-42ac-81e7-57363b82a399 with Priority: HIGHEST for action port [ 856.828164] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_rules [ 856.828292] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 856.828388] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5218bc-2d51-42ac-81e7-57363b82a399 with Priority: HIGHEST for action port [ 856.828919] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.829063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.829271] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.829356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.829555] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a5218bc-2d51-42ac-81e7-57363b82a399 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.829736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a5218bc-2d51-42ac-81e7-57363b82a399" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.829736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a5218bc-2d51-42ac-81e7-57363b82a399" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.830490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a5218bc-2d51-42ac-81e7-57363b82a399" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.830490] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a5218bc-2d51-42ac-81e7-57363b82a399',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.947788] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 856.947788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.947788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.947788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.947788] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.947788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.947788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.947788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.947788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.947788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.947788] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.151068] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 857.151281] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.151530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.151829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.152032] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.152883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.152883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.152883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.152883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.152883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.152883] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.153997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.154228] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.154398] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.154503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.154563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.155622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.155622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.155622] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.316827] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b392030a-efbc-48e0-a255-c920f33d1ae4 in Status: SUCCESS [ 857.316999] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b392030a-efbc-48e0-a255-c920f33d1ae4 deletion is rescheduled due to dependency. [ 857.317277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.334495] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a5218bc-2d51-42ac-81e7-57363b82a399 with status ACTIVE [ 857.337240] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.337401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.337469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.338030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.338030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.338030] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.338271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.338271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.338336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.338374] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.338556] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.338647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.338705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.338843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.338918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.339008] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a5218bc-2d51-42ac-81e7-57363b82a399 is going to be updated. [ 857.366887] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.367043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.367137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.367363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.367555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.367818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a5218bc-2d51-42ac-81e7-57363b82a399" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.450040] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.450324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.450324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.450584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.450783] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.450919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.451039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.451245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.451377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.451500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.451762] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.451861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.451935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.452084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.452308] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.452416] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.452484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.452638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.452737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.452816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.452910] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.655510] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.655817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.656473] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.958435] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27b912c1-294b-407e-bd8a-c81f04912b02: rpc.has_security_group_logging(os_id): False [ 857.976805] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.977743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.977743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.977743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.993394] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.993695] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.993822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.993891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.994149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.994236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.994473] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.994576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.994641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.994796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.994870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.995088] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.995185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.995246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.995386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.995460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.995546] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 858.051202] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.051397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.051506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.051729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.051872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.064383] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 858.158908] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.314213] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 858.314479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.314685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.314984] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.315093] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.662439] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.662636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.662763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.663041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.663167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.663274] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be updated. [ 858.695810] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.695956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.696047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.696246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.696389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.704223] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 858.817501] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.817679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.817758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.818168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.818706] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.818706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.818706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.819126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.819154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.819313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.819417] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.227030] env[69647]: INFO networking_nsxv3.common.synchronization [None req-09b42593-93c4-4bc4-9ad6-33260d0c02bb tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_rules [ 859.227392] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_rules [ 859.227725] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.227995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.227995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.228231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.228288] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.308090] env[69647]: INFO networking_nsxv3.common.synchronization [req-98be39e5-b0b5-4a8b-9848-f61e5e19f711 req-f167d988-2d52-47b7-b0b0-1626d38db37b tempest-VolumesAdminNegativeTest-778557798 tempest-VolumesAdminNegativeTest-778557798-project-member] Enqueued Resource ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e with Priority: HIGHEST for action security_group_members [ 859.308090] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e with Priority: HIGHEST for action security_group_members [ 859.308090] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4ef3a0-bf1a-4fa4-b038-850d2015902e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.308090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.308090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.308589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.308896] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.310117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.310117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.310117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.310117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.310117] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db4ef3a0-bf1a-4fa4-b038-850d2015902e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.322109] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.322258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.322258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.322758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.322758] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.323197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.323197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.323197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.323387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.323387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.323471] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.323553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.323615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.323780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.323937] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.324095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.324143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.324293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.324443] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.324492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.324557] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.382887] env[69647]: INFO networking_nsxv3.common.synchronization [None req-70a2beb0-1aa5-4cd1-9635-e0b178d3ad3a tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_rules [ 859.383588] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_rules [ 859.384101] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.384286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.748288] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.748288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.748288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.748288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.748288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.748288] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda already deleted. [ 859.748288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.748288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.748610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.748610] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.813903] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.814102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.814175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.814393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.814482] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.814677] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.814774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.814836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.814985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.815075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.815161] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e is going to be updated. [ 859.828573] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c427a432-7eaa-43a9-b426-56f256eb360c: rpc.has_security_group_logging(os_id): False [ 859.845727] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.845885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.845953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.846180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.846320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.848272] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.848398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.848454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.849630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.849630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.849630] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.849630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.849630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.849630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.849630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.849630] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.849630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.849630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.850299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.850299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.850299] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.850299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.850299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.850299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.851746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.851746] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be updated. [ 859.857949] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e in Status: IN_PROGRESS for 2s [ 859.890720] env[69647]: INFO networking_nsxv3.common.synchronization [req-479ae638-209a-47b1-adf7-43c3fd242f44 req-800c26d7-50b3-4408-9c62-42f183d5283f tempest-ServersNegativeTestJSON-2024807649 tempest-ServersNegativeTestJSON-2024807649-project-member] Enqueued Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 859.891744] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 859.891744] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.891744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.891744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.891947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.892635] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.892635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.892635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.892818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.892851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.892935] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.906816] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.908969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.908969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.908969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.908969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.923137] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 860.077649] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 860.078924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.269173] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.269654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.269654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.269775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.269834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.269944] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda already deleted. [ 860.270024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.398228] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.714015] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 860.714645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.715082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.715441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.717380] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.717380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.717380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.717380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.717380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.717380] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.758798] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-878 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.758798] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.758798] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.758798] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.758798] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.758798] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.758798] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.758798] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.758798] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.758798] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 860.759597] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.759867] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.760112] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.760433] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 860.760803] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.761129] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.781146] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.781314] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 860.781452] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.781650] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.781958] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-54256298-781a-4d6c-a6c4-fd80182a975d taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.782152] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-54256298-781a-4d6c-a6c4-fd80182a975d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.782281] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-54256298-781a-4d6c-a6c4-fd80182a975d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.782592] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-54256298-781a-4d6c-a6c4-fd80182a975d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.782753] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54256298-781a-4d6c-a6c4-fd80182a975d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.901865] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.220373] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.291293] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.291655] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.291708] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.291974] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.292147] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.292307] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 54256298-781a-4d6c-a6c4-fd80182a975d not found, creating... [ 861.292604] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.293481] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.293481] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.293481] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.293481] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.293612] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.293713] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.293850] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.294535] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.294879] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.295172] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 54256298-781a-4d6c-a6c4-fd80182a975d is going to be created. [ 861.317996] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.318539] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.318823] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.319122] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.319918] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.320280] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-54256298-781a-4d6c-a6c4-fd80182a975d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.403200] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.403542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.403637] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.403867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.403969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.404108] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 is going to be updated. [ 861.430890] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.431893] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.431893] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.432153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.432655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.459023] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: IN_PROGRESS for 2s [ 861.724968] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.811019] env[69647]: INFO networking_nsxv3.common.synchronization [None req-3f230899-427a-41f6-8284-ac498943bb6d None None] Enqueued Resource ID: 74bc2d53-27ce-43de-b1e6-4714d0a9796e with Priority: HIGHEST for action port [ 861.811019] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74bc2d53-27ce-43de-b1e6-4714d0a9796e with Priority: HIGHEST for action port [ 861.811019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-74bc2d53-27ce-43de-b1e6-4714d0a9796e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.811019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74bc2d53-27ce-43de-b1e6-4714d0a9796e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.811019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74bc2d53-27ce-43de-b1e6-4714d0a9796e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.811019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74bc2d53-27ce-43de-b1e6-4714d0a9796e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.811019] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74bc2d53-27ce-43de-b1e6-4714d0a9796e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.866843] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e in Status: SUCCESS [ 861.867030] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4ef3a0-bf1a-4fa4-b038-850d2015902e deletion is rescheduled due to dependency. [ 861.867154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4ef3a0-bf1a-4fa4-b038-850d2015902e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.935666] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 861.935889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.229192] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.229350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.229419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.229651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.229737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.229842] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be updated. [ 862.267115] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.267245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.267311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.267530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.267706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.277256] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 862.312927] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74bc2d53-27ce-43de-b1e6-4714d0a9796e [ 862.313209] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.314032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.314032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.314032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.314032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.314032] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74bc2d53-27ce-43de-b1e6-4714d0a9796e already deleted. [ 862.314032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74bc2d53-27ce-43de-b1e6-4714d0a9796e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.398225] env[69647]: INFO networking_nsxv3.common.synchronization [req-479ae638-209a-47b1-adf7-43c3fd242f44 req-34a64335-3999-4c90-aa93-884bb80989bd service nova] Enqueued Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_rules [ 862.398225] env[69647]: INFO networking_nsxv3.common.synchronization [req-479ae638-209a-47b1-adf7-43c3fd242f44 req-34a64335-3999-4c90-aa93-884bb80989bd service nova] Enqueued Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 862.398225] env[69647]: INFO networking_nsxv3.common.synchronization [req-479ae638-209a-47b1-adf7-43c3fd242f44 req-34a64335-3999-4c90-aa93-884bb80989bd service nova] Enqueued Resource ID: 54256298-781a-4d6c-a6c4-fd80182a975d with Priority: HIGHEST for action port [ 862.398469] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_rules [ 862.398579] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 862.398617] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54256298-781a-4d6c-a6c4-fd80182a975d with Priority: HIGHEST for action port [ 862.401436] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.401436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.401436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.401436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.401436] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.401436] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.401436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.401436] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-54256298-781a-4d6c-a6c4-fd80182a975d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.401861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54256298-781a-4d6c-a6c4-fd80182a975d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.401861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54256298-781a-4d6c-a6c4-fd80182a975d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.401861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54256298-781a-4d6c-a6c4-fd80182a975d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.401861] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54256298-781a-4d6c-a6c4-fd80182a975d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.907487] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.907610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.907820] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54256298-781a-4d6c-a6c4-fd80182a975d with status ACTIVE [ 862.908615] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.908615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.908615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.908615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.908615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.908615] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.908986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.908986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.908986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.908986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.909113] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.911920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.911920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.911920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.911920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.911920] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54256298-781a-4d6c-a6c4-fd80182a975d is going to be updated. [ 862.929027] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.929027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.929027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.929027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.929027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.929027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54256298-781a-4d6c-a6c4-fd80182a975d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.466811] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: SUCCESS [ 863.467063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.467265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.468091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.469383] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.469383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.469383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.469383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.469383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.469383] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.971443] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.287739] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 864.287940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.288117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.288907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.289182] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.289461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.289461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.289659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.289704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.289785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.290025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.290152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.290232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.290375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.290574] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.290673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.290735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.291129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.291129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.291129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.291129] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.315071] env[69647]: INFO networking_nsxv3.common.synchronization [None req-13ab4164-46d6-4a75-b5a7-13ca4a9dac6b None None] Enqueued Resource ID: 8bea7574-fec2-451c-b568-027edad385b0 with Priority: HIGHEST for action port [ 864.315911] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bea7574-fec2-451c-b568-027edad385b0 with Priority: HIGHEST for action port [ 864.315911] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bea7574-fec2-451c-b568-027edad385b0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.316021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bea7574-fec2-451c-b568-027edad385b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.316097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bea7574-fec2-451c-b568-027edad385b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.316351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bea7574-fec2-451c-b568-027edad385b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.316985] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bea7574-fec2-451c-b568-027edad385b0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.475381] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.766163] env[69647]: INFO networking_nsxv3.common.synchronization [req-3a7781cf-3802-421c-b0ff-7e6f21fbb625 req-82436490-447e-40a9-a4f7-4f7813109cfd tempest-ServersTestMultiNic-870967946 tempest-ServersTestMultiNic-870967946-project-member] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 864.766163] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 864.766323] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.766663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.766663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.766663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.766808] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.767195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.767195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.767195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.767195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.767372] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.794858] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c88cda88-ec94-40f5-96c9-0a718c5bbf44: rpc.has_security_group_logging(os_id): False [ 864.811734] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.811913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.811988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.812212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.812301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.812523] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.812633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.812703] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.812854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.812932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.813124] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.813218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.813281] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.813416] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.813490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.813664] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.813924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.813924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.814083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.814159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.814246] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be created. [ 864.819347] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8bea7574-fec2-451c-b568-027edad385b0 [ 864.819514] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.819638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.819698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.819838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.819916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.820009] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8bea7574-fec2-451c-b568-027edad385b0 already deleted. [ 864.820100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bea7574-fec2-451c-b568-027edad385b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.836850] env[69647]: INFO networking_nsxv3.common.synchronization [req-002bfaf9-67f5-485b-8027-30ff143ea7a4 req-fa4e302e-9149-4c43-8239-de4a24f32c23 tempest-ServerRescueNegativeTestJSON-41623176 tempest-ServerRescueNegativeTestJSON-41623176-project-member] Enqueued Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 864.837350] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 864.838202] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.838202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.838202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.838391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.838719] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.838719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.838719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.838882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.838882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.838938] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.867979] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.867979] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.867979] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.868699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.868699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.877248] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 864.943874] env[69647]: INFO networking_nsxv3.common.synchronization [req-3a7781cf-3802-421c-b0ff-7e6f21fbb625 req-47dd6be6-c572-4fbc-9ee0-d8aa040377c8 tempest-ServersTestMultiNic-870967946 tempest-ServersTestMultiNic-870967946-project-member] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 864.944480] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGHEST for action security_group_members [ 864.944794] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.945165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.978663] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.979802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.980398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.980398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.981711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.981945] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 is going to be updated. [ 865.012677] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.012834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.012980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.013253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.013333] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.023945] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: IN_PROGRESS for 2s [ 865.270521] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.289933] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.290173] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.290313] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.290693] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.290954] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.291341] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.291388] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.291613] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.291837] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.292230] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.292340] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.292440] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.292571] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.292729] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.292863] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.293044] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.310700] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.310884] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 865.311031] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.311221] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.311540] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-d41ff150-b0b2-4df7-abc9-f982f54fe80e taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.311816] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-d41ff150-b0b2-4df7-abc9-f982f54fe80e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.311869] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-d41ff150-b0b2-4df7-abc9-f982f54fe80e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.312210] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-d41ff150-b0b2-4df7-abc9-f982f54fe80e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.312345] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d41ff150-b0b2-4df7-abc9-f982f54fe80e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.342043] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.342043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.342043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.342043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.342345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.342599] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.342753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.342815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.342995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.343119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.343171] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 already deleted. [ 865.343267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.773669] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.815195] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.815568] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.815750] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.816080] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.816333] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.816523] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port d41ff150-b0b2-4df7-abc9-f982f54fe80e not found, creating... [ 865.816801] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.816968] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.817099] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.817937] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.818180] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.818547] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.818747] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.818907] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.819211] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.819392] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.819583] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: d41ff150-b0b2-4df7-abc9-f982f54fe80e is going to be created. [ 865.838019] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.838307] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.838479] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.838893] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.839150] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.839457] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-d41ff150-b0b2-4df7-abc9-f982f54fe80e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.277092] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.277303] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.277376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.277653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.278235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.278315] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be updated. [ 866.314327] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.314502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.314502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.314702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.314828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.323858] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 866.700020] env[69647]: INFO networking_nsxv3.common.synchronization [req-002bfaf9-67f5-485b-8027-30ff143ea7a4 req-6347ff41-7fe0-4ff7-8b56-85c0633c592c service nova] Enqueued Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_rules [ 866.700020] env[69647]: INFO networking_nsxv3.common.synchronization [req-002bfaf9-67f5-485b-8027-30ff143ea7a4 req-6347ff41-7fe0-4ff7-8b56-85c0633c592c service nova] Enqueued Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 866.700020] env[69647]: INFO networking_nsxv3.common.synchronization [req-002bfaf9-67f5-485b-8027-30ff143ea7a4 req-6347ff41-7fe0-4ff7-8b56-85c0633c592c service nova] Enqueued Resource ID: d41ff150-b0b2-4df7-abc9-f982f54fe80e with Priority: HIGHEST for action port [ 866.700020] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_rules [ 866.700020] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 866.700020] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41ff150-b0b2-4df7-abc9-f982f54fe80e with Priority: HIGHEST for action port [ 866.700929] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.701235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.701393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.704037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.704037] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.704037] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.704037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.704037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.704037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.704037] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.704037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.704037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.704037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.704037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.704037] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.705284] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-d41ff150-b0b2-4df7-abc9-f982f54fe80e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.705518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d41ff150-b0b2-4df7-abc9-f982f54fe80e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.705717] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d41ff150-b0b2-4df7-abc9-f982f54fe80e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.705948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d41ff150-b0b2-4df7-abc9-f982f54fe80e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.706117] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d41ff150-b0b2-4df7-abc9-f982f54fe80e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.889089] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 866.889384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.889498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.889859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.889978] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.033267] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: SUCCESS [ 867.033478] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.033980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.034219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.034413] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.034529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.034595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.034776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.034827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.034906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.034999] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.207864] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.208122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.208397] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.209303] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d41ff150-b0b2-4df7-abc9-f982f54fe80e with status ACTIVE [ 867.209549] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.209685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.209782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.209999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.211235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.211235] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.211235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.211235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.211235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.211235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.211235] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.211235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.211235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.213290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.213411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.213514] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d41ff150-b0b2-4df7-abc9-f982f54fe80e is going to be updated. [ 867.241774] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.241774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.241774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.241774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.242077] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.242110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d41ff150-b0b2-4df7-abc9-f982f54fe80e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.391839] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.391995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.392079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.392291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.392444] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.392534] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.392593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.392758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.392841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.392988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.392988] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.537388] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.537633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.537702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.537912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.538123] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.538275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.538375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.538605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.538738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.538863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.539101] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.539245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.539344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.540372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.540372] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.540372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.540372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.540655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.540700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.540779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.540895] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.715968] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.753174] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce7df3f3-0b61-4079-8a97-b700cfd1861e req-df36677a-f022-43b0-a89b-f32a6d1ae243 tempest-MigrationsAdminTest-1337534586 tempest-MigrationsAdminTest-1337534586-project-member] Enqueued Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 867.753681] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 867.753994] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.754132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.754200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.754393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.754547] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.754645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.754710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.754852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.754933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.755038] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.896323] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.896621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.896621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.896852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.897061] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.897186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.897268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.897429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.897506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.897598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.897747] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.897838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.897897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.898048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.898209] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.899140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.899140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.899140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.899140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.899140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.899140] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.044534] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 690e1872-1ae4-4c49-8159-ec39c82e2868: rpc.has_security_group_logging(os_id): False [ 868.063203] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.063349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.063423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.063638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.083271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.083865] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.083986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.084080] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.085337] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.085413] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.085624] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.085726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.085785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.085956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.086043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.086230] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.086332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.086389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.086517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.086586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.086675] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 is going to be updated. [ 868.171206] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.171405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.171476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.171780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.171954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.197313] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: IN_PROGRESS for 2s [ 868.221611] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.221611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.221611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.221611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.221918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.221918] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 is going to be created. [ 868.256849] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.261547] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.261757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.261892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.262123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.262302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.277898] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: UNINITIALIZED for 2s [ 868.335215] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 868.335215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.335215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.335215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.335215] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.335215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.335215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.335215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.335215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.335215] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.401145] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c88cda88-ec94-40f5-96c9-0a718c5bbf44: rpc.has_security_group_logging(os_id): False [ 868.421588] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.421768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.421835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.422076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.422203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.422437] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.422539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.422593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.422756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.422819] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.423014] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.424563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.424563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.424563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.424563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.424898] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.424976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.425071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.425241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.425358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.425534] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be updated. [ 868.482156] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.482390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.482476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.482704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.482855] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.495454] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 868.552396] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.552656] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.552805] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.553256] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.553776] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.554066] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.554279] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.554621] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.554880] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.555286] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.555357] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.555530] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.555720] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.555945] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.556168] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.556378] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.579350] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.579350] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 868.579350] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.579350] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-567" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.579350] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-d71590b5-7c98-4eea-9644-e789518162bd taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.579688] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-d71590b5-7c98-4eea-9644-e789518162bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.579688] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-d71590b5-7c98-4eea-9644-e789518162bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.580445] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-d71590b5-7c98-4eea-9644-e789518162bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.580445] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d71590b5-7c98-4eea-9644-e789518162bd',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.765196] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.836861] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.836861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.836861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.837078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.837078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.837330] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.837503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.837625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.837835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.837887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.837982] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be updated. [ 868.869375] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.869486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.869598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.869797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.869986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.878688] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: IN_PROGRESS for 2s [ 869.085596] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.085935] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.085935] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.086336] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.086500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.086666] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port d71590b5-7c98-4eea-9644-e789518162bd not found, creating... [ 869.087025] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.087203] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.087325] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.087559] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.087700] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.087989] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.088161] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.088279] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.088490] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.088625] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.088767] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: d71590b5-7c98-4eea-9644-e789518162bd is going to be created. [ 869.107103] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.107324] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.107513] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.107780] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.108027] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.108242] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-d71590b5-7c98-4eea-9644-e789518162bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.270532] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.270778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.270778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.270974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.271082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.271252] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 is going to be updated. [ 869.305143] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.305319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.305385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.305559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.305707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.313984] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: IN_PROGRESS for 2s [ 870.091717] env[69647]: INFO networking_nsxv3.common.synchronization [req-2c6cbc1f-2b87-42d9-8f27-9e2c6cc20fef req-872d7f90-fe7c-4e42-abce-f2715103c6fd tempest-MultipleCreateTestJSON-207473124 tempest-MultipleCreateTestJSON-207473124-project-member] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 870.092267] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 870.092578] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.092708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.092783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.092986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.093470] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.093579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.093645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.093809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.093894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.094032] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.212009] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: SUCCESS [ 870.212387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.216550] env[69647]: INFO networking_nsxv3.common.synchronization [req-25b1bf5a-4eef-4a32-96ff-ccdbcd27b0f5 req-c4ff0e14-4010-49f4-a7c5-05ebd594dad7 tempest-MultipleCreateTestJSON-207473124 tempest-MultipleCreateTestJSON-207473124-project-member] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 870.217160] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 870.217478] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.217578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.240410] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce7df3f3-0b61-4079-8a97-b700cfd1861e req-f4946f33-09c5-41f5-bfd1-3763ed9120e0 service nova] Enqueued Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_rules [ 870.240703] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce7df3f3-0b61-4079-8a97-b700cfd1861e req-f4946f33-09c5-41f5-bfd1-3763ed9120e0 service nova] Enqueued Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 870.240901] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce7df3f3-0b61-4079-8a97-b700cfd1861e req-f4946f33-09c5-41f5-bfd1-3763ed9120e0 service nova] Enqueued Resource ID: d71590b5-7c98-4eea-9644-e789518162bd with Priority: HIGHEST for action port [ 870.242435] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_rules [ 870.242435] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 870.242750] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d71590b5-7c98-4eea-9644-e789518162bd with Priority: HIGHEST for action port [ 870.243336] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.243336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.243336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.243511] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.243552] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.245627] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.246634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.246634] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-d71590b5-7c98-4eea-9644-e789518162bd taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.246634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d71590b5-7c98-4eea-9644-e789518162bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.246634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d71590b5-7c98-4eea-9644-e789518162bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.247081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d71590b5-7c98-4eea-9644-e789518162bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.247081] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d71590b5-7c98-4eea-9644-e789518162bd',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.287579] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: SUCCESS [ 870.287790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.288648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.288893] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.289109] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.289259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.289328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.289584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.289677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.289767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.289861] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.505198] env[69647]: INFO networking_nsxv3.common.synchronization [req-6ea6c611-72f9-466c-b487-5748582933ef req-9076dcef-c555-4e68-82ed-c45956c59243 tempest-ServerRescueNegativeTestJSON-41623176 tempest-ServerRescueNegativeTestJSON-41623176-project-member] Enqueued Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 870.505738] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 870.506709] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 870.506825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.511366] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.511366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.511366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.511366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.511366] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.511366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.511366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.511366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.511366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.511366] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.600401] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.749652] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.750660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.750903] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d71590b5-7c98-4eea-9644-e789518162bd with status ACTIVE [ 870.751100] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.751233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.751307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.752498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.752605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.752799] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.752904] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.752968] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.753161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.753243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.753449] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.753531] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.753581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.753721] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.753798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.753885] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d71590b5-7c98-4eea-9644-e789518162bd is going to be updated. [ 870.772673] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.772878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.772923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.773139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.773301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.773512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d71590b5-7c98-4eea-9644-e789518162bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.792088] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.792240] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.889854] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c427a432-7eaa-43a9-b426-56f256eb360c in Status: SUCCESS [ 870.889854] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c427a432-7eaa-43a9-b426-56f256eb360c deletion is rescheduled due to dependency. [ 870.890079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.012766] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.103911] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.125364] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.125878] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.126203] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.126560] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.126964] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.127287] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.127515] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.127829] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.128152] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.128518] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.130024] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.130024] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.130024] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.130024] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.130024] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.130024] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.149421] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.150126] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 871.150126] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.150126] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.150420] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-f5453532-f361-4b9f-87c6-1f402ad1d116 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.150573] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-f5453532-f361-4b9f-87c6-1f402ad1d116" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.150872] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-f5453532-f361-4b9f-87c6-1f402ad1d116" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.151106] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-f5453532-f361-4b9f-87c6-1f402ad1d116" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.151284] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5453532-f361-4b9f-87c6-1f402ad1d116',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.323289] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: SUCCESS [ 871.323737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.323737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.323877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.324034] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.324549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.324549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.324549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.324549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.324724] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.516866] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.608664] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.608847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.608969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.609132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.609218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.609337] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be updated. [ 871.635708] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.635708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.637647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.637647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.637647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.649260] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 871.656862] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.657377] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.657509] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.657770] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.658367] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.658367] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port f5453532-f361-4b9f-87c6-1f402ad1d116 not found, creating... [ 871.658646] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.658817] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.658933] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.659173] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.659304] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.659590] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.659744] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.659856] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.660214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.660377] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.660518] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: f5453532-f361-4b9f-87c6-1f402ad1d116 is going to be created. [ 871.680381] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.680614] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.680749] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.681028] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.681271] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.681536] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-f5453532-f361-4b9f-87c6-1f402ad1d116" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.826940] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.019536] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.019806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.019872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.020110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.020196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.020337] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 is going to be updated. [ 872.049328] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.049328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.049328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.049613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.049775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.057868] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: IN_PROGRESS for 2s [ 872.328927] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.587480] env[69647]: INFO networking_nsxv3.common.synchronization [req-6ea6c611-72f9-466c-b487-5748582933ef req-3509d6ba-6201-42b2-a0ed-bb1c48ee3950 service nova] Enqueued Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_rules [ 872.587737] env[69647]: INFO networking_nsxv3.common.synchronization [req-6ea6c611-72f9-466c-b487-5748582933ef req-3509d6ba-6201-42b2-a0ed-bb1c48ee3950 service nova] Enqueued Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 872.587868] env[69647]: INFO networking_nsxv3.common.synchronization [req-6ea6c611-72f9-466c-b487-5748582933ef req-3509d6ba-6201-42b2-a0ed-bb1c48ee3950 service nova] Enqueued Resource ID: f5453532-f361-4b9f-87c6-1f402ad1d116 with Priority: HIGHEST for action port [ 872.588562] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_rules [ 872.588913] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 872.588913] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5453532-f361-4b9f-87c6-1f402ad1d116 with Priority: HIGHEST for action port [ 872.589488] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.589707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.590070] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.590302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.590578] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5453532-f361-4b9f-87c6-1f402ad1d116 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.590782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5453532-f361-4b9f-87c6-1f402ad1d116" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.590950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5453532-f361-4b9f-87c6-1f402ad1d116" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.591247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5453532-f361-4b9f-87c6-1f402ad1d116" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.591399] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5453532-f361-4b9f-87c6-1f402ad1d116',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.646690] env[69647]: INFO networking_nsxv3.common.synchronization [req-1a7604f7-ebaa-4e4b-bb8d-334468d158c5 req-2a264d90-48f1-4949-a1e0-78ab2bd58e05 tempest-ServersNegativeTestJSON-2024807649 tempest-ServersNegativeTestJSON-2024807649-project-member] Enqueued Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 872.652086] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 872.652086] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.652086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.652086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.652086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.652086] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.652086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.652086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.652086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.652086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.652086] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.832219] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.832219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.832219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.832410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.832410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.832562] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 is going to be updated. [ 872.946584] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.946734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.946802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.947018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.947165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.955419] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: IN_PROGRESS for 2s [ 873.093638] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5453532-f361-4b9f-87c6-1f402ad1d116 with status ACTIVE [ 873.093638] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.093802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.093944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.094191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.094401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.094518] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.094644] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.094728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.094959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.095083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.095331] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.095398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.095450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.095629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.095729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.095851] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5453532-f361-4b9f-87c6-1f402ad1d116 is going to be updated. [ 873.122387] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.122387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.122387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.122613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.122723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.122890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5453532-f361-4b9f-87c6-1f402ad1d116" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.152543] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.656170] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.658364] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 873.658599] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.658760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.658975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.659252] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.659310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.659341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.659498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.659577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.659669] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.068674] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: SUCCESS [ 874.068674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.068829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.068995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.069208] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.069417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.069454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.069647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.069750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.069854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.070061] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.070221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.070221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.070362] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.070497] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.070604] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.070663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.070786] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.070928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.070928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.071041] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.071862] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.072042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.072187] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.072274] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.072327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.072475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.073414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.073414] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.159146] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.159297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.159479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.159701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.159796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.159901] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 is going to be updated. [ 874.161538] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.161693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.161746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.161897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.161980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.162166] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.162263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.162330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.162484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.162537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.162621] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be updated. [ 874.183787] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.183924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.183995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.184209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.184352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.185950] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.186064] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.186137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.186316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.186414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.202018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: IN_PROGRESS for 2s [ 874.204869] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 874.574176] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cca2232a-e86b-4244-935e-7ec99c85e7c0: rpc.has_security_group_logging(os_id): False [ 874.578582] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.595671] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.595881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.595881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.596129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.596215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.596442] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.596550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.596595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.596765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.596837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.597025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.597646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.597646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.597646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.597646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.597646] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.597646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.597887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.597887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.597887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.597989] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 is going to be created. [ 874.654490] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.654640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.654742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.654966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.655170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.678406] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: IN_PROGRESS for 2s [ 874.966723] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: SUCCESS [ 874.966977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.967196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.967411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.967641] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.967762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.967827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.967989] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.968297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.968297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.968297] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.077675] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.285190] env[69647]: INFO networking_nsxv3.common.synchronization [req-b3000b89-5dfc-42c2-828d-632660151582 req-62a7162d-436b-4a5b-8544-802b7a394510 tempest-ImagesTestJSON-954996409 tempest-ImagesTestJSON-954996409-project-member] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 875.285190] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 875.287476] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.287476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.287476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.287476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.287476] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.287476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.287476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.287476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.287476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.287476] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.475413] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.475575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.475648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.475874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.476057] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.476163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.476228] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.476389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.476475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.476562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.476709] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.476803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.476864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.477009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.477151] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.477245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.477304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.477440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.477514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.477594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.477683] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.581988] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.581988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.581988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.581988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.581988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.581988] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 is going to be updated. [ 875.610949] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.610949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.610949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.610949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.610949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.617562] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: IN_PROGRESS for 2s [ 875.792544] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.792544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.792544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.792544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.792544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.792544] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.792544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.792544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.792544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.792544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.792544] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 875.820057] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.820241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.820315] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.820605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.820832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.825786] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-984 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.826014] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.826178] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.826435] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.826692] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.826849] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.826965] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.827192] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.828624] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.828624] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.828624] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.828624] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.828624] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.828624] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.828624] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.828624] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.830920] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 875.844960] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.845170] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 875.845316] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.845489] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.845828] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-e77cf848-ef17-476d-9e83-5c78dba6d422 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.846037] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-e77cf848-ef17-476d-9e83-5c78dba6d422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.846168] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-e77cf848-ef17-476d-9e83-5c78dba6d422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.846477] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-e77cf848-ef17-476d-9e83-5c78dba6d422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.847023] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e77cf848-ef17-476d-9e83-5c78dba6d422',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.981676] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c97e0fb-c576-4b45-ad7b-02877e627733: rpc.has_security_group_logging(os_id): False [ 875.999885] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.000076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.000156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.000329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.000419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.000634] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.001615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.001615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.001615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.001615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.001615] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.001615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.001615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.001615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.001615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.001972] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.001972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.001972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.002579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.002688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.002788] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 is going to be updated. [ 876.065716] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.065903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.066010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.066267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.066429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.078907] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: IN_PROGRESS for 2s [ 876.212654] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: SUCCESS [ 876.212919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.213687] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 876.213872] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 deletion is rescheduled due to dependency. [ 876.214153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.348716] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.348932] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.349056] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.349422] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.349615] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.349746] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port e77cf848-ef17-476d-9e83-5c78dba6d422 not found, creating... [ 876.350574] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.350574] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.350574] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.350830] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.350830] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.352063] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.352063] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.352063] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.352063] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.352063] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.352063] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: e77cf848-ef17-476d-9e83-5c78dba6d422 is going to be created. [ 876.372303] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.372552] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.372747] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.372959] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.373221] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.373452] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-e77cf848-ef17-476d-9e83-5c78dba6d422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.692169] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: SUCCESS [ 876.692411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.692588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.692803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.692891] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.197161] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.197537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.241299] env[69647]: INFO networking_nsxv3.common.synchronization [req-b3000b89-5dfc-42c2-828d-632660151582 req-bc14c42a-e029-4061-9c92-4980e48b20d5 service nova] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_rules [ 877.241472] env[69647]: INFO networking_nsxv3.common.synchronization [req-b3000b89-5dfc-42c2-828d-632660151582 req-bc14c42a-e029-4061-9c92-4980e48b20d5 service nova] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 877.241608] env[69647]: INFO networking_nsxv3.common.synchronization [req-b3000b89-5dfc-42c2-828d-632660151582 req-bc14c42a-e029-4061-9c92-4980e48b20d5 service nova] Enqueued Resource ID: e77cf848-ef17-476d-9e83-5c78dba6d422 with Priority: HIGHEST for action port [ 877.242119] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_rules [ 877.242119] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 877.242119] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e77cf848-ef17-476d-9e83-5c78dba6d422 with Priority: HIGHEST for action port [ 877.244460] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.244460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.244460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.244460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.244460] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.244460] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.244811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.244811] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-e77cf848-ef17-476d-9e83-5c78dba6d422 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.244811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e77cf848-ef17-476d-9e83-5c78dba6d422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.244943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e77cf848-ef17-476d-9e83-5c78dba6d422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.245184] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e77cf848-ef17-476d-9e83-5c78dba6d422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.245184] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e77cf848-ef17-476d-9e83-5c78dba6d422',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.631798] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: SUCCESS [ 877.631798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.631798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.631798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.631798] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.631798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.631798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.631798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.631798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.631798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.631798] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.749091] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.749091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.749091] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e77cf848-ef17-476d-9e83-5c78dba6d422 with status ACTIVE [ 877.749091] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.749091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.749091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.749091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.749091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.749091] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.749091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.749091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.749091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.749091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.749091] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.750108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.750108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.750108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.750108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.750108] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e77cf848-ef17-476d-9e83-5c78dba6d422 is going to be updated. [ 877.771387] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.771639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.771639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.771924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.771985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.772138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e77cf848-ef17-476d-9e83-5c78dba6d422" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.841670] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 877.841801] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 deletion is rescheduled due to dependency. [ 877.841902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.842098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.842319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.842495] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.842607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.842677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.842841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.842926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.843040] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.093075] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: SUCCESS [ 878.093305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.133903] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.134068] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.134138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.134360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.134521] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.134615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.134672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.134808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.134889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.134970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.135124] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.135212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.135267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.135462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.135610] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.135698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.135753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.135888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.135954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.136045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.136162] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.346759] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.640463] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cca2232a-e86b-4244-935e-7ec99c85e7c0: rpc.has_security_group_logging(os_id): False [ 878.656406] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.659019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.659019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.659019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.659839] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.662039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.662039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.662039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.662039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.662039] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 is going to be updated. [ 878.725189] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.725189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.725189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.727035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.727035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.739437] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: IN_PROGRESS for 2s [ 878.848949] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.352486] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.352816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.352816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.354396] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.354396] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.354396] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 879.381769] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.381941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.382025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.382238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.382382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.390753] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 880.754090] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: SUCCESS [ 880.754090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.402023] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 881.402023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.402023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.402023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.402023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.402023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.402023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.402023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.402023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.402023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.402023] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.905235] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.905596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.905596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.905674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.905882] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.905970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.906035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.906195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.906283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.906376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.906520] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.906613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.906674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.906817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.906952] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.907079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.907148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.907293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.907366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.907446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.907534] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.242995] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 882.243218] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 882.411208] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac810154-f096-4495-a2c8-d43e5bb3d1a2: rpc.has_security_group_logging(os_id): False [ 882.426974] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.427185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.427270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.427676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.427738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.427915] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.428044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.428107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.428285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.428358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.428573] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.428668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.428736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.429196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.429308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.429505] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.432018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.432018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.432018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.432018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.432018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 882.508023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.508023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.508023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.508023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.508023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.529709] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 883.650366] env[69647]: INFO networking_nsxv3.common.synchronization [req-11bf042c-1d5a-45cb-87b4-ad66d4dbfe59 req-5dfef5fe-8340-4e53-ac19-6d405c6bf4f5 tempest-ServerActionsV293TestJSON-654612076 tempest-ServerActionsV293TestJSON-654612076-project-member] Enqueued Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_members [ 883.650366] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGHEST for action security_group_members [ 883.650366] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d92e25ad-3d95-4a6f-bb9e-55be52df486a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.650366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.650366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.650366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.650366] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.650366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.650366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.650366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.650366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.650366] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.156554] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.156746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.156826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.157161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.157394] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.157502] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.157599] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.157663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.157886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.157979] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.158086] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a is going to be updated. [ 884.188379] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.188574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.188574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.188774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.188915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.197913] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a in Status: IN_PROGRESS for 2s [ 884.544402] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 884.544402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.208063] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a in Status: SUCCESS [ 886.208308] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a deletion is rescheduled due to dependency. [ 886.208356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.081597] env[69647]: INFO networking_nsxv3.common.synchronization [None req-044ee10e-56a8-4a12-ad5b-3a6e479355e1 None None] Enqueued Resource ID: a7494493-4489-4eb7-afe9-a252ab16264f with Priority: HIGHEST for action port [ 888.082817] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7494493-4489-4eb7-afe9-a252ab16264f with Priority: HIGHEST for action port [ 888.084774] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7494493-4489-4eb7-afe9-a252ab16264f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.084774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7494493-4489-4eb7-afe9-a252ab16264f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.084774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7494493-4489-4eb7-afe9-a252ab16264f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.084774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7494493-4489-4eb7-afe9-a252ab16264f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.084774] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7494493-4489-4eb7-afe9-a252ab16264f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.586388] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7494493-4489-4eb7-afe9-a252ab16264f [ 888.586755] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.587034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.587104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.587364] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.587491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.587604] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7494493-4489-4eb7-afe9-a252ab16264f already deleted. [ 888.588172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7494493-4489-4eb7-afe9-a252ab16264f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.717921] env[69647]: INFO networking_nsxv3.common.synchronization [req-d3ebbe2c-0998-4de7-b10e-0a0c00616a73 req-d77dd595-0ad0-4e2e-9138-e40fcd954402 tempest-InstanceActionsTestJSON-1176701786 tempest-InstanceActionsTestJSON-1176701786-project-member] Enqueued Resource ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d with Priority: HIGHEST for action security_group_members [ 889.717921] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d with Priority: HIGHEST for action security_group_members [ 889.718840] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.719087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.719220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.719543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.719749] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.720516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.720516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.720516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.720516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.720516] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5145c69-8ea2-4421-9b34-0a1bbf81d37d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.042320] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-454 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.046345] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-454" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.046345] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-454" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.046345] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-454" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.046345] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.046345] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.046345] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.046345] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.046345] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.046345] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.046345] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.046345] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.046345] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.046345] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.046345] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.046345] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.077938] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.077938] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 890.077938] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.077938] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-454" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.077938] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-9f6ad837-e9cf-4743-99f4-81056cc2bf65 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.077938] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-9f6ad837-e9cf-4743-99f4-81056cc2bf65" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.077938] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-9f6ad837-e9cf-4743-99f4-81056cc2bf65" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.077938] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-9f6ad837-e9cf-4743-99f4-81056cc2bf65" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.077938] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f6ad837-e9cf-4743-99f4-81056cc2bf65',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.225288] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.225288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.225288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.225288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.225288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.225288] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.225288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.225288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.225288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.225288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.225288] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d already deleted. [ 890.225288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.335268] env[69647]: INFO networking_nsxv3.common.synchronization [None req-24c60a23-ea8f-45e8-bda0-b63ce39ad52f None None] Enqueued Resource ID: d1aae522-ab40-406c-8124-bbf315c17754 with Priority: HIGHEST for action port [ 890.335268] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1aae522-ab40-406c-8124-bbf315c17754 with Priority: HIGHEST for action port [ 890.335268] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1aae522-ab40-406c-8124-bbf315c17754 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.335268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1aae522-ab40-406c-8124-bbf315c17754" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.335268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1aae522-ab40-406c-8124-bbf315c17754" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.335804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1aae522-ab40-406c-8124-bbf315c17754" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.336026] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1aae522-ab40-406c-8124-bbf315c17754',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.582024] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.582024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.582024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.582024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.582024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.582024] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 9f6ad837-e9cf-4743-99f4-81056cc2bf65 not found, creating... [ 890.582024] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.582024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.582024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.582024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.582024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.583490] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.583928] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.584362] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.585602] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.585897] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.587571] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 9f6ad837-e9cf-4743-99f4-81056cc2bf65 is going to be created. [ 890.604979] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.606501] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.607032] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.607487] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.608520] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.608687] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-9f6ad837-e9cf-4743-99f4-81056cc2bf65" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.840217] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1aae522-ab40-406c-8124-bbf315c17754 [ 890.840601] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.840667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.840701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.844025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.844025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.844025] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1aae522-ab40-406c-8124-bbf315c17754 already deleted. [ 890.844025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1aae522-ab40-406c-8124-bbf315c17754" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.849906] env[69647]: INFO networking_nsxv3.common.synchronization [req-7b22163b-6900-4656-b98c-c20a2c6c10e0 req-4f8a5222-d3f2-4259-85c3-9d3775966d67 tempest-ServersAdminTestJSON-1923625429 tempest-ServersAdminTestJSON-1923625429-project-member] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 890.850521] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 890.850893] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.852503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.852611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.852967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.853156] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.853276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.853331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.853490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.853578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.853678] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.357940] env[69647]: INFO networking_nsxv3.common.synchronization [req-d3ebbe2c-0998-4de7-b10e-0a0c00616a73 req-16072f93-1cd1-48ed-a125-63224204387c service nova] Enqueued Resource ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d with Priority: HIGHEST for action security_group_rules [ 891.357940] env[69647]: INFO networking_nsxv3.common.synchronization [req-d3ebbe2c-0998-4de7-b10e-0a0c00616a73 req-16072f93-1cd1-48ed-a125-63224204387c service nova] Enqueued Resource ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d with Priority: HIGHEST for action security_group_members [ 891.357940] env[69647]: INFO networking_nsxv3.common.synchronization [req-d3ebbe2c-0998-4de7-b10e-0a0c00616a73 req-16072f93-1cd1-48ed-a125-63224204387c service nova] Enqueued Resource ID: 9f6ad837-e9cf-4743-99f4-81056cc2bf65 with Priority: HIGHEST for action port [ 891.358697] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d with Priority: HIGHEST for action security_group_rules [ 891.358697] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d with Priority: HIGHEST for action security_group_members [ 891.358697] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f6ad837-e9cf-4743-99f4-81056cc2bf65 with Priority: HIGHEST for action port [ 891.358906] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.359588] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5145c69-8ea2-4421-9b34-0a1bbf81d37d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.359743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.359851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.360084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.360200] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5145c69-8ea2-4421-9b34-0a1bbf81d37d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.360982] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.361112] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.361180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.361491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.361491] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.361581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.361659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.361827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.361916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.366016] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5145c69-8ea2-4421-9b34-0a1bbf81d37d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.366691] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f6ad837-e9cf-4743-99f4-81056cc2bf65 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.366845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f6ad837-e9cf-4743-99f4-81056cc2bf65" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.366900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f6ad837-e9cf-4743-99f4-81056cc2bf65" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.367102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f6ad837-e9cf-4743-99f4-81056cc2bf65" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.367238] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f6ad837-e9cf-4743-99f4-81056cc2bf65',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.870406] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.871489] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.871601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.871839] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5145c69-8ea2-4421-9b34-0a1bbf81d37d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.874567] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f6ad837-e9cf-4743-99f4-81056cc2bf65 with status ACTIVE [ 891.874567] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.874567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.874567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.875020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.875100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.875355] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.875422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.875455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.875617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.875691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.875901] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.875993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.876168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.876333] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.876423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.876584] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f6ad837-e9cf-4743-99f4-81056cc2bf65 is going to be updated. [ 891.896297] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.896442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.896515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.896724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.896866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.897079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f6ad837-e9cf-4743-99f4-81056cc2bf65" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.378599] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5145c69-8ea2-4421-9b34-0a1bbf81d37d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.384852] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.384852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.384852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.385414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.385532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.385657] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 892.416512] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.416639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.416719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.416939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.417094] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.428169] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 892.886367] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.889112] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.889290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.889630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.889730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.889845] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d is going to be created. [ 892.912692] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.912692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.912692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.913223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.913223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.926280] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d in Status: UNINITIALIZED for 2s [ 894.435923] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 894.436270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.935716] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d in Status: SUCCESS [ 894.935956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.936141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.936382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.936571] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.936685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.936853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.937065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.937146] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.937234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.937350] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5145c69-8ea2-4421-9b34-0a1bbf81d37d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.439964] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.440369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.440369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.440556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.440705] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.440835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.440906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.441108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.441198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.441288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.441458] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.441583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.441847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.441847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.442030] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.442091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.442154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.442291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.442367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.442450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.442540] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5145c69-8ea2-4421-9b34-0a1bbf81d37d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.944397] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5145c69-8ea2-4421-9b34-0a1bbf81d37d: rpc.has_security_group_logging(os_id): False [ 895.960551] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.960810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.960810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.961170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.961170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.961266] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.961363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.961419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.961565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.961641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.961905] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.962029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.962084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.962207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.962283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.962458] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.962550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.962604] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.962861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.962976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.963062] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d is going to be created. [ 896.017535] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.017935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.018052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.018265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.018447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.027967] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d in Status: IN_PROGRESS for 2s [ 896.359394] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 896.359544] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 897.556350] env[69647]: INFO networking_nsxv3.common.synchronization [req-526b1aad-c3ef-45f9-8263-8b461417eee6 req-d783aef1-2b39-4267-ac85-319e6050c3ac tempest-ServersWithSpecificFlavorTestJSON-1052584011 tempest-ServersWithSpecificFlavorTestJSON-1052584011-project-member] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 897.556772] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 897.557079] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.557196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.557261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.557458] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.557599] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.557686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.557744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.557880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.557958] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.561487] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.044052] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d in Status: SUCCESS [ 898.044052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.066024] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.066024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.066024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.066024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.066024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.066024] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.066024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.066024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.066024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.066024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.066024] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f is going to be updated. [ 898.090528] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.090528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.090528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.090528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.090528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.101742] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: IN_PROGRESS for 2s [ 898.220385] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-692 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.221554] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-692" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.221554] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-692" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.222127] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-692" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.222165] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.222335] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.222459] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.222735] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.222920] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.223161] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.223281] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.223428] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.223553] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.223678] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.227160] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.227419] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.250632] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.254095] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 898.254095] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.254095] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-692" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.254095] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-36db7424-670c-4cc1-9604-68b978ddd75a taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.254095] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-36db7424-670c-4cc1-9604-68b978ddd75a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.254095] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-36db7424-670c-4cc1-9604-68b978ddd75a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.254095] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-36db7424-670c-4cc1-9604-68b978ddd75a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.254095] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36db7424-670c-4cc1-9604-68b978ddd75a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.756675] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.756998] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.757056] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.757459] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.757644] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.757810] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 36db7424-670c-4cc1-9604-68b978ddd75a not found, creating... [ 898.758355] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.758355] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.758527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.759517] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.759777] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.760246] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.760514] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.760708] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.761077] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.761319] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.761824] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 36db7424-670c-4cc1-9604-68b978ddd75a is going to be created. [ 898.785298] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.785657] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.785913] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.786348] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.792451] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.792451] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-36db7424-670c-4cc1-9604-68b978ddd75a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.081446] env[69647]: INFO networking_nsxv3.common.synchronization [req-77115596-dd9b-4095-847d-0012d33c7e40 req-718271d4-b0e4-4e7b-92c0-9c3c5d1e65b0 tempest-VolumesAdminNegativeTest-778557798 tempest-VolumesAdminNegativeTest-778557798-project-member] Enqueued Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_members [ 899.082090] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGHEST for action security_group_members [ 899.082401] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-4691b465-a6c4-42d2-86ce-653d3dc9c97e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.082622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.082622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.085939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.086210] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.086348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.086421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.086612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.086707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.086866] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.591552] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.591755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.591808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.592159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.592261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.592490] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.592595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.592595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.592807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.592807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.592915] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e is going to be updated. [ 899.621378] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.621555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.622248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.622248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.623178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.632275] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e in Status: IN_PROGRESS for 2s [ 899.653020] env[69647]: INFO networking_nsxv3.common.synchronization [req-526b1aad-c3ef-45f9-8263-8b461417eee6 req-730d60e8-bb9c-496b-b6e7-98040a539247 service nova] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_rules [ 899.653020] env[69647]: INFO networking_nsxv3.common.synchronization [req-526b1aad-c3ef-45f9-8263-8b461417eee6 req-730d60e8-bb9c-496b-b6e7-98040a539247 service nova] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 899.653020] env[69647]: INFO networking_nsxv3.common.synchronization [req-526b1aad-c3ef-45f9-8263-8b461417eee6 req-730d60e8-bb9c-496b-b6e7-98040a539247 service nova] Enqueued Resource ID: 36db7424-670c-4cc1-9604-68b978ddd75a with Priority: HIGHEST for action port [ 899.653020] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_rules [ 899.653020] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 899.653020] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36db7424-670c-4cc1-9604-68b978ddd75a with Priority: HIGHEST for action port [ 899.653020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.653020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.653020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.653020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.653641] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.653902] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.653993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.654188] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-36db7424-670c-4cc1-9604-68b978ddd75a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.654313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36db7424-670c-4cc1-9604-68b978ddd75a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.654412] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36db7424-670c-4cc1-9604-68b978ddd75a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.654642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36db7424-670c-4cc1-9604-68b978ddd75a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.654747] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36db7424-670c-4cc1-9604-68b978ddd75a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.747465] env[69647]: INFO networking_nsxv3.common.synchronization [req-846cf463-5069-4352-9a00-a31f9a9546bb req-a7f8c4b1-e220-40fc-bd63-9bcb41225736 tempest-ServerMetadataNegativeTestJSON-10968474 tempest-ServerMetadataNegativeTestJSON-10968474-project-member] Enqueued Resource ID: ed16e80e-360a-42fc-afac-b1d84a97137e with Priority: HIGHEST for action security_group_members [ 899.747465] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed16e80e-360a-42fc-afac-b1d84a97137e with Priority: HIGHEST for action security_group_members [ 899.747465] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed16e80e-360a-42fc-afac-b1d84a97137e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.747465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.747465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.747465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.747465] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.747465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.747465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.751340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.751491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.751627] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed16e80e-360a-42fc-afac-b1d84a97137e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.111530] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: SUCCESS [ 900.111530] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f deletion is rescheduled due to dependency. [ 900.111530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.112090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.112090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.112153] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.115340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.115340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.115340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.115340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.115340] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.142675] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-568 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.143536] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-568" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.143536] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-568" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.143536] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-568" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.145104] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.145104] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.145104] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.145104] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.145104] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.145104] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.145589] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.145589] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.145589] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.145589] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.145724] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.145827] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.157816] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.157928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.158395] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36db7424-670c-4cc1-9604-68b978ddd75a with status ACTIVE [ 900.158572] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.158683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.158750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.158942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.159049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.159204] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.159299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.159360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.159504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.159579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.159777] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.159892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.159955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.160171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.160250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.160338] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36db7424-670c-4cc1-9604-68b978ddd75a is going to be updated. [ 900.166098] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.166316] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 900.166466] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.166634] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-568" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.166934] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.167123] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.167260] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.167553] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.167699] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.187286] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.188729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.188729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.188729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.188729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.188729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36db7424-670c-4cc1-9604-68b978ddd75a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.256285] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.256528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.256675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.257015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.257197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.257469] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.258892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.258892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.258892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.258892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.258892] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed16e80e-360a-42fc-afac-b1d84a97137e already deleted. [ 900.258892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.614795] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.670642] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.670866] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.670996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.671298] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.671449] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.671603] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5 not found, creating... [ 900.671992] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.672229] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.672307] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.672528] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.672691] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.672965] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.673146] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.673300] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.673461] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.673594] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.673734] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5 is going to be created. [ 900.694417] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.695276] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.695276] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.695440] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.695965] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.695965] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.118216] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.456825] env[69647]: INFO networking_nsxv3.common.synchronization [req-846cf463-5069-4352-9a00-a31f9a9546bb req-186cf787-4800-43d4-8dec-002805b83a6c service nova] Enqueued Resource ID: ed16e80e-360a-42fc-afac-b1d84a97137e with Priority: HIGHEST for action security_group_rules [ 901.456913] env[69647]: INFO networking_nsxv3.common.synchronization [req-846cf463-5069-4352-9a00-a31f9a9546bb req-186cf787-4800-43d4-8dec-002805b83a6c service nova] Enqueued Resource ID: ed16e80e-360a-42fc-afac-b1d84a97137e with Priority: HIGHEST for action security_group_members [ 901.461018] env[69647]: INFO networking_nsxv3.common.synchronization [req-846cf463-5069-4352-9a00-a31f9a9546bb req-186cf787-4800-43d4-8dec-002805b83a6c service nova] Enqueued Resource ID: 59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5 with Priority: HIGHEST for action port [ 901.461018] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed16e80e-360a-42fc-afac-b1d84a97137e with Priority: HIGHEST for action security_group_rules [ 901.461018] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed16e80e-360a-42fc-afac-b1d84a97137e with Priority: HIGHEST for action security_group_members [ 901.461018] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5 with Priority: HIGHEST for action port [ 901.461018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed16e80e-360a-42fc-afac-b1d84a97137e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.461018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.461018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.461018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.461018] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed16e80e-360a-42fc-afac-b1d84a97137e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.461018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed16e80e-360a-42fc-afac-b1d84a97137e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.461018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.461018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.461018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.461018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.461018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.461018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.461018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.461018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.462174] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed16e80e-360a-42fc-afac-b1d84a97137e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.462174] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.462503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.462503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.462503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.462503] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.623082] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.623082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.623082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.623082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.623082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.623082] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f is going to be updated. [ 901.639430] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e in Status: SUCCESS [ 901.639662] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e deletion is rescheduled due to dependency. [ 901.639773] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.649057] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.649190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.649290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.649459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.649600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.657139] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: IN_PROGRESS for 2s [ 901.964304] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed16e80e-360a-42fc-afac-b1d84a97137e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.966881] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed16e80e-360a-42fc-afac-b1d84a97137e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.967274] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.967725] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5 with status ACTIVE [ 901.968422] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.968422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.968422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.970027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.970027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.970027] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.970027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.970027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.970027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.970027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.970419] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.970419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.970419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.970816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.970816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.970816] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5 is going to be updated. [ 901.990559] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.990815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.990815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.991036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.991205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.991375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59d37d3e-f05d-49f9-a3f9-5fcd7bf073e5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.383850] env[69647]: INFO networking_nsxv3.common.synchronization [req-3abfacfd-c3c1-4e8e-94c3-48604d19f1fc req-28b58814-7d46-4469-b9a6-9554fd94b2e9 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_members [ 902.384716] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_members [ 902.386198] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.386306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.386345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.386603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.386775] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.386954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.387050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.387218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.387302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.387396] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd6af1f-0d53-486d-ac51-c6ef7bb925cc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.467380] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed16e80e-360a-42fc-afac-b1d84a97137e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.832524] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.832524] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.832700] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.833908] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.833908] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.833908] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.833908] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.833908] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.833908] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.834415] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.834415] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.834415] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.834415] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.834415] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.834671] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.834671] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.854462] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.854616] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 902.854772] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.854925] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.855254] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-4358ae4b-304d-487c-aad2-d3e16d510339 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.855417] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-4358ae4b-304d-487c-aad2-d3e16d510339" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.855533] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-4358ae4b-304d-487c-aad2-d3e16d510339" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.855854] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-4358ae4b-304d-487c-aad2-d3e16d510339" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.856030] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4358ae4b-304d-487c-aad2-d3e16d510339',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.889790] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.890047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.890157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.890456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.890572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.890798] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.890947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.891054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.891262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.891381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.891493] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc already deleted. [ 902.891614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.973068] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.973253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.973346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.973576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.973683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.973786] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed16e80e-360a-42fc-afac-b1d84a97137e is going to be created. [ 902.995009] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.995176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.995247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.995553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.995722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.003666] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed16e80e-360a-42fc-afac-b1d84a97137e in Status: UNINITIALIZED for 2s [ 903.363041] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.363041] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.363041] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.363041] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.363506] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.364013] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 4358ae4b-304d-487c-aad2-d3e16d510339 not found, creating... [ 903.364561] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.365194] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.365428] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.366210] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.366389] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.366889] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.367102] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.367222] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.367472] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.367634] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.367885] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 4358ae4b-304d-487c-aad2-d3e16d510339 is going to be created. [ 903.390906] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.393398] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.393398] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.393398] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.393398] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.393398] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-4358ae4b-304d-487c-aad2-d3e16d510339" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.669169] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: SUCCESS [ 903.669466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.669683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.670025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.670289] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.670427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.670498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.670689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.670827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.670974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.671173] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.173609] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.256634] env[69647]: INFO networking_nsxv3.common.synchronization [req-3abfacfd-c3c1-4e8e-94c3-48604d19f1fc req-9be7f480-d712-4d0d-97e3-4a43d812c8c4 service nova] Enqueued Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_rules [ 904.256821] env[69647]: INFO networking_nsxv3.common.synchronization [req-3abfacfd-c3c1-4e8e-94c3-48604d19f1fc req-9be7f480-d712-4d0d-97e3-4a43d812c8c4 service nova] Enqueued Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_members [ 904.256964] env[69647]: INFO networking_nsxv3.common.synchronization [req-3abfacfd-c3c1-4e8e-94c3-48604d19f1fc req-9be7f480-d712-4d0d-97e3-4a43d812c8c4 service nova] Enqueued Resource ID: 4358ae4b-304d-487c-aad2-d3e16d510339 with Priority: HIGHEST for action port [ 904.261026] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_rules [ 904.261026] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_members [ 904.261026] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4358ae4b-304d-487c-aad2-d3e16d510339 with Priority: HIGHEST for action port [ 904.261026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.261026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.261026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.261026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.261026] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bd6af1f-0d53-486d-ac51-c6ef7bb925cc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.261026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.261026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.261026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.261638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.261638] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.261638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.261822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.261892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.262834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.262834] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd6af1f-0d53-486d-ac51-c6ef7bb925cc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.263470] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-4358ae4b-304d-487c-aad2-d3e16d510339 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.263470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4358ae4b-304d-487c-aad2-d3e16d510339" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.263470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4358ae4b-304d-487c-aad2-d3e16d510339" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.263470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4358ae4b-304d-487c-aad2-d3e16d510339" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.263470] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4358ae4b-304d-487c-aad2-d3e16d510339',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.676242] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b26cf444-4671-4a90-a2a4-c6ca9787ad9f: rpc.has_security_group_logging(os_id): False [ 904.693905] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.693905] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.693905] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.694154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.694453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.694528] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.694609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.696108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.696108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.696108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.696108] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f is going to be updated. [ 904.755735] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.756073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.756073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.756290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.756441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.765104] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bd6af1f-0d53-486d-ac51-c6ef7bb925cc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.766658] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.766798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.766971] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4358ae4b-304d-487c-aad2-d3e16d510339 with status ACTIVE [ 904.767163] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.767277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.767343] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.767539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.767622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.767786] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.767880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.767941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.768203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.768250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.768411] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.768504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.768565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.768706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.768781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.768866] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4358ae4b-304d-487c-aad2-d3e16d510339 is going to be updated. [ 904.770908] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: IN_PROGRESS for 2s [ 904.790970] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.791140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.791218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.791422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.791562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.791723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4358ae4b-304d-487c-aad2-d3e16d510339" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.014975] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed16e80e-360a-42fc-afac-b1d84a97137e in Status: SUCCESS [ 905.015211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.015378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.015594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.015783] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.015898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.015962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.016133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.016212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.016297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.016387] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed16e80e-360a-42fc-afac-b1d84a97137e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.272520] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bd6af1f-0d53-486d-ac51-c6ef7bb925cc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.524165] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed16e80e-360a-42fc-afac-b1d84a97137e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.524165] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.524165] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed16e80e-360a-42fc-afac-b1d84a97137e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.524165] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.524165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.525266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.525266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.525266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.525266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.525266] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed16e80e-360a-42fc-afac-b1d84a97137e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.774265] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.774619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.774619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.776272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.776366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.776469] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc is going to be created. [ 905.804854] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.804986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.805072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.805275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.805434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.814855] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc in Status: UNINITIALIZED for 2s [ 906.028018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed16e80e-360a-42fc-afac-b1d84a97137e: rpc.has_security_group_logging(os_id): False [ 906.049197] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.049197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.049197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.049197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.049197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.049197] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.049197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.049197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.049197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.049197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.049197] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.049197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.049782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.049782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.049782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.049973] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.050039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.050071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.050293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.050293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.050383] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed16e80e-360a-42fc-afac-b1d84a97137e is going to be created. [ 906.106603] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.106768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.106844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.107107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.107280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.121152] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed16e80e-360a-42fc-afac-b1d84a97137e in Status: IN_PROGRESS for 2s [ 906.417707] env[69647]: INFO networking_nsxv3.common.synchronization [req-2a8a7d1f-e589-4822-9b4e-fcabd9b84a5b req-a2116de1-27bc-4b50-a264-bc17fe1d48e3 tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 906.418873] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 906.418873] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.419126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.419126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.419416] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.419995] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.419995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.419995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.420177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.420177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.420291] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.785429] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: SUCCESS [ 906.785736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.925249] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.925249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.925249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.925249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.925249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.925249] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.925249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.925249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.925249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.925249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.925249] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 906.950283] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.950450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.950495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.950724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.950883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.958867] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 907.826113] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc in Status: SUCCESS [ 907.826417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.826569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.827065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.827065] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.827235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.827235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.827338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.827401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.827833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.827833] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bd6af1f-0d53-486d-ac51-c6ef7bb925cc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.134669] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed16e80e-360a-42fc-afac-b1d84a97137e in Status: SUCCESS [ 908.134669] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.335333] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bd6af1f-0d53-486d-ac51-c6ef7bb925cc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.836949] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc: rpc.has_security_group_logging(os_id): False [ 908.856872] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.857813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.857813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.857813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.857813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.857813] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.857813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.857813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.858246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.858246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.858246] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc is going to be created. [ 908.915838] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.915838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.915838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.915838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.915838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.924728] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc in Status: IN_PROGRESS for 2s [ 908.970867] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 908.970867] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 deletion is rescheduled due to dependency. [ 908.970867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.655908] env[69647]: INFO networking_nsxv3.common.synchronization [None req-92c3e963-c8c9-4a33-a33d-a17fb9d5ccd8 tempest-ServerRescueNegativeTestJSON-41623176 tempest-ServerRescueNegativeTestJSON-41623176-project-member] Enqueued Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_rules [ 909.656825] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_rules [ 909.656825] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.656825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.657021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.657523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.657523] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deec7c2d-a3e1-4f84-97a5-b5433b7b69ff',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.861955] env[69647]: INFO networking_nsxv3.common.synchronization [req-d122f54c-ecfa-421a-b215-739063789ade req-8a5808f5-993f-4e09-a898-3a630c3fa826 tempest-InstanceActionsTestJSON-1176701786 tempest-InstanceActionsTestJSON-1176701786-project-member] Enqueued Resource ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d with Priority: HIGHEST for action security_group_members [ 909.862533] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d with Priority: HIGHEST for action security_group_members [ 909.862843] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.862966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.863231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.863492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.863673] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.863811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.863877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.864094] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.864294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.864294] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5145c69-8ea2-4421-9b34-0a1bbf81d37d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.909216] env[69647]: INFO networking_nsxv3.common.synchronization [None req-f2be9ecd-4547-46c1-843c-c80eaa733ddf tempest-ServerRescueNegativeTestJSON-41623176 tempest-ServerRescueNegativeTestJSON-41623176-project-member] Enqueued Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_rules [ 909.910037] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_rules [ 909.910350] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.910460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.096617] env[69647]: INFO networking_nsxv3.common.synchronization [None req-50409e72-1b2b-45c7-a27e-180ea3ea3205 None None] Enqueued Resource ID: 3e71f529-e94c-4023-85c2-9dbd66682464 with Priority: HIGHEST for action port [ 910.097161] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e71f529-e94c-4023-85c2-9dbd66682464 with Priority: HIGHEST for action port [ 910.097458] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e71f529-e94c-4023-85c2-9dbd66682464 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.097577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e71f529-e94c-4023-85c2-9dbd66682464" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.098257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e71f529-e94c-4023-85c2-9dbd66682464" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.098719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e71f529-e94c-4023-85c2-9dbd66682464" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.098836] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e71f529-e94c-4023-85c2-9dbd66682464',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.176206] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.176526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.176526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.176603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.176636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.176738] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff already deleted. [ 910.176818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.177329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.177500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.177587] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deec7c2d-a3e1-4f84-97a5-b5433b7b69ff',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.367563] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.367875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.367920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.368149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.368236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.368439] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.368562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.368593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.368737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.368811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.369598] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d is going to be updated. [ 910.398020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.398020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.398020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.398020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.398020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.406710] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d in Status: IN_PROGRESS for 2s [ 910.601958] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e71f529-e94c-4023-85c2-9dbd66682464 [ 910.603663] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.603663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.603663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.603663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.603663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.603663] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e71f529-e94c-4023-85c2-9dbd66682464 already deleted. [ 910.603663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e71f529-e94c-4023-85c2-9dbd66682464" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.701503] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.701679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.701754] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.702052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.702109] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.702212] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff already deleted. [ 910.702295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.937608] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc in Status: SUCCESS [ 910.937608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.052603] env[69647]: INFO networking_nsxv3.common.synchronization [req-450b5fe8-f295-45a9-839c-87aa21e064ac req-eb535474-f362-46f5-8c4c-f0b8b6753fa6 tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_members [ 911.053387] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_members [ 911.053830] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.054069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.054810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.054810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.055087] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.055507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.055507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.055507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.055507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.055813] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.558389] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.558620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.558710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.559044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.559140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.560107] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.560107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.560107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.560107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.560107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.560107] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda already deleted. [ 911.560107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.587335] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-451 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.587545] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.587692] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.588691] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.589087] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.589322] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.589528] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.589868] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.590064] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.590324] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 911.590448] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.590580] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.590742] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.590884] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 911.591039] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.591223] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.613091] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.613350] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 911.613761] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.613981] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.614387] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-31cf4d91-af3f-4f48-96b2-a3b78967154a taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.614594] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-31cf4d91-af3f-4f48-96b2-a3b78967154a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.614776] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-31cf4d91-af3f-4f48-96b2-a3b78967154a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.615689] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-31cf4d91-af3f-4f48-96b2-a3b78967154a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.615901] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31cf4d91-af3f-4f48-96b2-a3b78967154a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.118553] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.118850] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.118916] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.119291] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.119417] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.119575] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 31cf4d91-af3f-4f48-96b2-a3b78967154a not found, creating... [ 912.119905] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.120159] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.120284] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.120514] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.120653] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.121967] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.121967] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.122138] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.122303] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.122448] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.122589] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 31cf4d91-af3f-4f48-96b2-a3b78967154a is going to be created. [ 912.143571] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.143724] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.143855] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.144137] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.144371] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.144608] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-31cf4d91-af3f-4f48-96b2-a3b78967154a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.288060] env[69647]: INFO networking_nsxv3.common.synchronization [None req-03f3bd90-1632-42e2-a58c-dca8f20dbc1f tempest-ServersTestBootFromVolume-391508555 tempest-ServersTestBootFromVolume-391508555-project-member] Enqueued Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_rules [ 912.289265] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_rules [ 912.289583] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.289919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.290058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.290330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.290419] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fbffbeb-5173-4e7a-966f-dee89646c2c1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.415833] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d in Status: SUCCESS [ 912.416606] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5145c69-8ea2-4421-9b34-0a1bbf81d37d deletion is rescheduled due to dependency. [ 912.416606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5145c69-8ea2-4421-9b34-0a1bbf81d37d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.520072] env[69647]: INFO networking_nsxv3.common.synchronization [None req-7d18b852-f89c-4f5c-8ad1-d23a132f5240 tempest-ServersTestBootFromVolume-391508555 tempest-ServersTestBootFromVolume-391508555-project-member] Enqueued Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_rules [ 912.520452] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_rules [ 912.520948] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.520948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.532841] env[69647]: INFO networking_nsxv3.common.synchronization [None req-4c118792-54d9-44e0-9e21-25b8edee6251 None None] Enqueued Resource ID: 9e1e7509-8815-4b61-ba24-e5ff298e848e with Priority: HIGHEST for action port [ 912.533157] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e1e7509-8815-4b61-ba24-e5ff298e848e with Priority: HIGHEST for action port [ 912.534269] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e1e7509-8815-4b61-ba24-e5ff298e848e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.534269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e1e7509-8815-4b61-ba24-e5ff298e848e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.534269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e1e7509-8815-4b61-ba24-e5ff298e848e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.534269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e1e7509-8815-4b61-ba24-e5ff298e848e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.534269] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e1e7509-8815-4b61-ba24-e5ff298e848e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.819937] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.820085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.820157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.820466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.820573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.820670] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 already deleted. [ 912.820751] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.820897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.821060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.821143] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fbffbeb-5173-4e7a-966f-dee89646c2c1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.831993] env[69647]: INFO networking_nsxv3.common.synchronization [req-450b5fe8-f295-45a9-839c-87aa21e064ac req-45987b8e-a882-44e2-ac3c-4e757f347499 service nova] Enqueued Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_rules [ 912.832196] env[69647]: INFO networking_nsxv3.common.synchronization [req-450b5fe8-f295-45a9-839c-87aa21e064ac req-45987b8e-a882-44e2-ac3c-4e757f347499 service nova] Enqueued Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_members [ 912.832339] env[69647]: INFO networking_nsxv3.common.synchronization [req-450b5fe8-f295-45a9-839c-87aa21e064ac req-45987b8e-a882-44e2-ac3c-4e757f347499 service nova] Enqueued Resource ID: 31cf4d91-af3f-4f48-96b2-a3b78967154a with Priority: HIGHEST for action port [ 912.832552] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_rules [ 912.832672] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_members [ 912.832770] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31cf4d91-af3f-4f48-96b2-a3b78967154a with Priority: HIGHEST for action port [ 912.833342] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.833422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.833490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.833662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.833736] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.836888] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.836888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.836888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.836888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.836888] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.836888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.836888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.836888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.836888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.836888] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.837318] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-31cf4d91-af3f-4f48-96b2-a3b78967154a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.837318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31cf4d91-af3f-4f48-96b2-a3b78967154a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.837318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31cf4d91-af3f-4f48-96b2-a3b78967154a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.837535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31cf4d91-af3f-4f48-96b2-a3b78967154a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.837583] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31cf4d91-af3f-4f48-96b2-a3b78967154a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.038409] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e1e7509-8815-4b61-ba24-e5ff298e848e [ 913.039543] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.039543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.039543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.039543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.039543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.039543] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e1e7509-8815-4b61-ba24-e5ff298e848e already deleted. [ 913.039543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e1e7509-8815-4b61-ba24-e5ff298e848e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.340407] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.340407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.340407] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.342066] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.343278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.343278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.343278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.343278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.343278] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 already deleted. [ 913.343278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.343278] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31cf4d91-af3f-4f48-96b2-a3b78967154a with status ACTIVE [ 913.343278] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.343278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.343684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.343684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.343684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.343772] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.343844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.343844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.343968] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.344045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.344247] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.344349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.344391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.345191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.345191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.345191] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31cf4d91-af3f-4f48-96b2-a3b78967154a is going to be updated. [ 913.367258] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.367405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.367474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.367689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.367804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.367967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31cf4d91-af3f-4f48-96b2-a3b78967154a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.846885] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.348552] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.348881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.348881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.348998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.349104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.349219] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda is going to be created. [ 914.374403] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.374593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.374686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.374925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.375134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.386043] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda in Status: UNINITIALIZED for 2s [ 916.025066] env[69647]: INFO networking_nsxv3.common.synchronization [req-8e3a0a97-97d8-43b4-9916-79edc166cdb9 req-865efa0c-6f05-4efd-aa05-8141426da3ef tempest-ServerMetadataNegativeTestJSON-10968474 tempest-ServerMetadataNegativeTestJSON-10968474-project-member] Enqueued Resource ID: ed16e80e-360a-42fc-afac-b1d84a97137e with Priority: HIGHEST for action security_group_members [ 916.025066] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed16e80e-360a-42fc-afac-b1d84a97137e with Priority: HIGHEST for action security_group_members [ 916.025066] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed16e80e-360a-42fc-afac-b1d84a97137e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.025066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.025066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.025066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.025066] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.025066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.025066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.026243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.026448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.026701] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed16e80e-360a-42fc-afac-b1d84a97137e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.396935] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda in Status: SUCCESS [ 916.397176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.397342] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.397561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.397760] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.397912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.397985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.398123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.398210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.398300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.398397] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.529543] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.529714] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.529782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.530023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.530916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.530916] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.530916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.530916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.530916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.530916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.530916] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed16e80e-360a-42fc-afac-b1d84a97137e is going to be updated. [ 916.559654] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.559842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.559918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.560090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.560239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.569455] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed16e80e-360a-42fc-afac-b1d84a97137e in Status: IN_PROGRESS for 2s [ 916.901643] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.404216] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda: rpc.has_security_group_logging(os_id): False [ 917.422021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.422021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.422021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.422021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.422021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.422021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.422021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.422021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.422021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.422021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.422021] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda is going to be created. [ 917.490275] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.493060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.493060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.493060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.493060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.506712] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda in Status: IN_PROGRESS for 2s [ 917.917039] env[69647]: INFO networking_nsxv3.common.synchronization [req-f3474f69-317d-4f0a-8b2f-e08d7ff1eb3e req-11a05085-86f5-4b91-8fce-604c155766ca tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 917.917834] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 917.918176] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.918305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.918371] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.918575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.918714] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.918889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.918960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.919107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.919189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.919282] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.952865] env[69647]: INFO networking_nsxv3.common.synchronization [req-f3474f69-317d-4f0a-8b2f-e08d7ff1eb3e req-11a05085-86f5-4b91-8fce-604c155766ca tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_rules [ 917.954704] env[69647]: INFO networking_nsxv3.common.synchronization [req-f3474f69-317d-4f0a-8b2f-e08d7ff1eb3e req-11a05085-86f5-4b91-8fce-604c155766ca tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 917.955119] env[69647]: INFO networking_nsxv3.common.synchronization [req-f3474f69-317d-4f0a-8b2f-e08d7ff1eb3e req-11a05085-86f5-4b91-8fce-604c155766ca tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 with Priority: HIGHEST for action port [ 917.955579] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_rules [ 917.955711] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 917.955808] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 with Priority: HIGHEST for action port [ 917.956331] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.956425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.956510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.956685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.956764] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.961020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.961020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.961020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.961020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.961020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.961020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.961020] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74fbb09f-844c-4cd9-a88b-d5485a8d89c8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.423669] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.458369] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.458504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.463054] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 with status ACTIVE [ 918.463243] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.463369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.463439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.463650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.463735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.463907] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.464052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.464153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.464317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.464397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.464582] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.464668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.464734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.464894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.465017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.465147] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 is going to be updated. [ 918.484530] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.484685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.484766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.484993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.485155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.485313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.581015] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed16e80e-360a-42fc-afac-b1d84a97137e in Status: SUCCESS [ 918.581194] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed16e80e-360a-42fc-afac-b1d84a97137e deletion is rescheduled due to dependency. [ 918.581311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.927585] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.430931] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.432500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.432500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.432500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.432500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.432500] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 is going to be updated. [ 919.459436] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.459591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.459665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.460024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.460179] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.468929] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: IN_PROGRESS for 2s [ 919.517536] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda in Status: SUCCESS [ 919.517753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.944217] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-93c67f0f-0d4e-48a2-83a7-5b873a5fcb6c tempest-ListServersNegativeTestJSON-225317695 tempest-ListServersNegativeTestJSON-225317695-project-member] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 919.944217] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 919.944217] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.944217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.944217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.944217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.944700] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.944967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.945170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.945442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.945646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.946478] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.270021] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.270021] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.270021] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.270021] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.270021] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.270649] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.270925] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.273142] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.273142] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.273142] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.273142] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.273142] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.273142] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.273142] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.273142] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.273142] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.291324] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.291747] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.294074] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.294074] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.294074] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1be0671d-cfde-4ba9-a944-38ba81269515 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.294074] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1be0671d-cfde-4ba9-a944-38ba81269515" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.294074] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1be0671d-cfde-4ba9-a944-38ba81269515" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.294074] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1be0671d-cfde-4ba9-a944-38ba81269515" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.294074] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be0671d-cfde-4ba9-a944-38ba81269515',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.448719] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.448719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.448719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.448719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.448719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.449422] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.449422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.449422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.449422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.449422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.449422] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc already deleted. [ 920.449422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.798449] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.798788] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.799030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.799426] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.799627] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.799813] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1be0671d-cfde-4ba9-a944-38ba81269515 not found, creating... [ 920.800085] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.800250] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.800370] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.800594] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.800733] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.805059] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.805287] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.805417] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.805641] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.805783] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.805935] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1be0671d-cfde-4ba9-a944-38ba81269515 is going to be created. [ 920.825760] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.825760] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.825760] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.825760] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.825760] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.825760] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1be0671d-cfde-4ba9-a944-38ba81269515" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.140562] env[69647]: INFO networking_nsxv3.common.synchronization [req-b15135f3-c3fa-49c1-8602-a9bbe0f08170 req-2d5995fd-83f0-4333-877c-f4c3887846d8 tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 921.140562] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 921.140562] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.140562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.163405] env[69647]: INFO networking_nsxv3.common.synchronization [req-b15135f3-c3fa-49c1-8602-a9bbe0f08170 req-2d5995fd-83f0-4333-877c-f4c3887846d8 tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_rules [ 921.163618] env[69647]: INFO networking_nsxv3.common.synchronization [req-b15135f3-c3fa-49c1-8602-a9bbe0f08170 req-2d5995fd-83f0-4333-877c-f4c3887846d8 tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 921.163783] env[69647]: INFO networking_nsxv3.common.synchronization [req-b15135f3-c3fa-49c1-8602-a9bbe0f08170 req-2d5995fd-83f0-4333-877c-f4c3887846d8 tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 with Priority: HIGHEST for action port [ 921.164340] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_rules [ 921.164492] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 921.164733] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 with Priority: HIGHEST for action port [ 921.165065] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.165172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.166979] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.167062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.167296] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.167400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.167465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.167675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.167744] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74fbb09f-844c-4cd9-a88b-d5485a8d89c8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.478158] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: SUCCESS [ 921.478502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.478657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.478900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.479110] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.480095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.480095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.480095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.480095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.480095] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.541314] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-7ac69e11-7bbd-4ee8-ba9c-4aebe719feba service nova] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_rules [ 921.541314] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-7ac69e11-7bbd-4ee8-ba9c-4aebe719feba service nova] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 921.541314] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-7ac69e11-7bbd-4ee8-ba9c-4aebe719feba service nova] Enqueued Resource ID: 1be0671d-cfde-4ba9-a944-38ba81269515 with Priority: HIGHEST for action port [ 921.541314] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_rules [ 921.541314] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 921.541314] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1be0671d-cfde-4ba9-a944-38ba81269515 with Priority: HIGHEST for action port [ 921.541314] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.541314] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.543071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.543071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.543071] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.543296] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.543296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.543403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.546248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.546248] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.546248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.546248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.546248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.546248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.546248] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.546248] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1be0671d-cfde-4ba9-a944-38ba81269515 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.546248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1be0671d-cfde-4ba9-a944-38ba81269515" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.546248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1be0671d-cfde-4ba9-a944-38ba81269515" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.546248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1be0671d-cfde-4ba9-a944-38ba81269515" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.546248] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be0671d-cfde-4ba9-a944-38ba81269515',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.673025] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 with status ACTIVE [ 921.673025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.673025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.673025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.673025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.673025] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74fbb09f-844c-4cd9-a88b-d5485a8d89c8 is going to be updated. [ 921.693933] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.693933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.693933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.693933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.693933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.693933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74fbb09f-844c-4cd9-a88b-d5485a8d89c8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.850876] env[69647]: INFO networking_nsxv3.common.synchronization [None req-aa0ff7f3-7ddb-492f-af68-66b60b4b24fb tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_rules [ 921.851031] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_rules [ 921.851535] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6168f488-7a73-4458-9cef-b4375e37e273 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.852879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.852879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.852879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.852879] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6168f488-7a73-4458-9cef-b4375e37e273',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.981593] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.015891] env[69647]: INFO networking_nsxv3.common.synchronization [None req-60f7d0d8-0a7b-4631-b48d-5e675c4e7c2d tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_rules [ 922.016403] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_rules [ 922.016716] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6168f488-7a73-4458-9cef-b4375e37e273 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.016820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.046968] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.047141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.047318] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1be0671d-cfde-4ba9-a944-38ba81269515 with status ACTIVE [ 922.047482] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.047586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.047698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.047919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.048016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.048194] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.048301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.048339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.048494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.048570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.048749] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.048841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.048979] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.049488] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.049612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.049718] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1be0671d-cfde-4ba9-a944-38ba81269515 is going to be updated. [ 922.051051] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.071780] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.074915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.074915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.074915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.074915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.074915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1be0671d-cfde-4ba9-a944-38ba81269515" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.371912] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.372218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.372218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.372429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.372514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.372620] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6168f488-7a73-4458-9cef-b4375e37e273 already deleted. [ 922.372718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.373373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.373373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.373373] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6168f488-7a73-4458-9cef-b4375e37e273',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.484911] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.554614] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.644030] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-30e6c0b4-faa5-487c-9781-3aba75e2cdb6 tempest-ListServersNegativeTestJSON-225317695 tempest-ListServersNegativeTestJSON-225317695-project-member] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 922.645393] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 922.645393] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.645393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.895254] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.895407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.895472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.895679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.895769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.895867] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6168f488-7a73-4458-9cef-b4375e37e273 already deleted. [ 922.895951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.926276] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.926506] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.927958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.927958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.927958] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.927958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.927958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.927958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.927958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.928428] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.928428] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.928428] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.928428] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.928570] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.928965] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.928965] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.949921] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.949921] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 922.949921] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.949921] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.949921] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-70322022-c42f-4df9-9169-0fc15f0964bd taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.949921] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-70322022-c42f-4df9-9169-0fc15f0964bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.949921] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-70322022-c42f-4df9-9169-0fc15f0964bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.949921] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-70322022-c42f-4df9-9169-0fc15f0964bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.949921] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70322022-c42f-4df9-9169-0fc15f0964bd',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.986996] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.987225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.987225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.987433] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.987518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.987613] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 is going to be updated. [ 923.012538] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.012701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.012701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.012867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.013057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.027019] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: IN_PROGRESS for 2s [ 923.058480] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.058704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.058817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.059141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.059279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.059422] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc is going to be created. [ 923.082624] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.082833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.082910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.083132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.083295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.092926] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: UNINITIALIZED for 2s [ 923.450773] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.451606] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.451606] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.451606] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.451606] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.452115] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 70322022-c42f-4df9-9169-0fc15f0964bd not found, creating... [ 923.452196] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.452291] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.452416] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.452646] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.452807] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.453122] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.453287] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.453408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.453626] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.453781] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.453936] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 70322022-c42f-4df9-9169-0fc15f0964bd is going to be created. [ 923.475465] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.477060] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.477518] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.477762] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.478048] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.478309] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-70322022-c42f-4df9-9169-0fc15f0964bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.210278] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-78bae3a0-7501-4674-bd9c-766a5b5c014f service nova] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_rules [ 924.210519] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-78bae3a0-7501-4674-bd9c-766a5b5c014f service nova] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 924.210694] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-78bae3a0-7501-4674-bd9c-766a5b5c014f service nova] Enqueued Resource ID: 70322022-c42f-4df9-9169-0fc15f0964bd with Priority: HIGHEST for action port [ 924.211468] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_rules [ 924.211626] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 924.211764] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70322022-c42f-4df9-9169-0fc15f0964bd with Priority: HIGHEST for action port [ 924.212055] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.212163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.212371] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.212475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.212677] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-70322022-c42f-4df9-9169-0fc15f0964bd taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.212838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70322022-c42f-4df9-9169-0fc15f0964bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.212984] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70322022-c42f-4df9-9169-0fc15f0964bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.213138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70322022-c42f-4df9-9169-0fc15f0964bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.213310] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70322022-c42f-4df9-9169-0fc15f0964bd',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.715431] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70322022-c42f-4df9-9169-0fc15f0964bd with status ACTIVE [ 924.715660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.715801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.715872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.716123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.716214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.716400] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.716508] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.716572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.716723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.716799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.716979] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.717084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.717145] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.717280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.717352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.717436] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70322022-c42f-4df9-9169-0fc15f0964bd is going to be updated. [ 924.737238] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.737401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.737460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.737624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.737758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.737918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70322022-c42f-4df9-9169-0fc15f0964bd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.035356] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: SUCCESS [ 925.035566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.035728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.036049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.036122] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.036242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.036345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.036450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.036764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.036764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.036764] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.037558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.037785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.037986] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.037986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.038107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.038264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.038341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.038401] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.104025] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: SUCCESS [ 925.104025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.104025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.104025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.104025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.104025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.104025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.104025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.104025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.104025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.104025] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.104938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.105819] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.106006] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.106176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.106285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.106580] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.106580] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.106684] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.116713] env[69647]: INFO networking_nsxv3.common.synchronization [req-06c21bd6-06b7-473a-b654-6801563a7f06 req-1d6faca6-e002-4449-9495-7a0a2acf8d77 tempest-AttachInterfacesUnderV243Test-864750179 tempest-AttachInterfacesUnderV243Test-864750179-project-member] Enqueued Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 925.116713] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 with Priority: HIGHEST for action security_group_members [ 925.116713] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.116713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.540928] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.542020] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.608475] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.608608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.608806] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.044759] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.045879] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fe058e6-1ee1-46bc-bd88-8e66f89cb196: rpc.has_security_group_logging(os_id): False [ 926.078397] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.078593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.078593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.078812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.078912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.079194] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.079335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.079414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.079521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.079601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.079703] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 is going to be updated. [ 926.111021] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.134699] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.134844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.134902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.135372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.135372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.149596] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: IN_PROGRESS for 2s [ 926.499692] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-95f8f46a-16f2-4683-9d3f-e246f71a5090 tempest-ListServersNegativeTestJSON-225317695 tempest-ListServersNegativeTestJSON-225317695-project-member] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 926.500240] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 926.501033] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.501033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.548963] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.549353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.549353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.549487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.549541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.549672] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 is going to be updated. [ 926.574280] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.574447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.574521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.574772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.574930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.583685] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: IN_PROGRESS for 2s [ 926.613401] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.613562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.613634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.613848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.613988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.614040] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc is going to be updated. [ 926.639309] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.639309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.639309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.639309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.639309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.647402] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: IN_PROGRESS for 2s [ 927.068257] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.068257] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.068257] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.068257] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.068257] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.075019] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.075019] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.075019] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.075019] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.075019] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.075019] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.075019] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.075019] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.075019] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.075019] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.075019] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.101607] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.101607] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 927.101607] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.101607] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-510" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.101607] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-e24426e2-c96e-440a-b8c5-6a6d58498258 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.101607] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-e24426e2-c96e-440a-b8c5-6a6d58498258" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.101607] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-e24426e2-c96e-440a-b8c5-6a6d58498258" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.101911] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-e24426e2-c96e-440a-b8c5-6a6d58498258" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.101911] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e24426e2-c96e-440a-b8c5-6a6d58498258',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.605444] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.605785] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.605829] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.606106] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.606272] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.606423] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port e24426e2-c96e-440a-b8c5-6a6d58498258 not found, creating... [ 927.606690] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.606851] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.606975] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.607234] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.607377] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.607657] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.607815] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.607934] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.608378] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.608558] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.608735] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: e24426e2-c96e-440a-b8c5-6a6d58498258 is going to be created. [ 927.629998] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.630248] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.630408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.630722] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.630966] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.631217] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-e24426e2-c96e-440a-b8c5-6a6d58498258" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.164165] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: SUCCESS [ 928.164411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.164943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.165196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.165284] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.593466] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 in Status: SUCCESS [ 928.593846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.593846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.594525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.594525] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.594525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.594525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.594760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.594760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.595833] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.608498] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-aece7809-5803-4ce5-8fab-df0d6d3b9160 service nova] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_rules [ 928.608701] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-aece7809-5803-4ce5-8fab-df0d6d3b9160 service nova] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 928.608826] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8344c9c-1272-4aa5-b83c-6cff3a0b680e req-aece7809-5803-4ce5-8fab-df0d6d3b9160 service nova] Enqueued Resource ID: e24426e2-c96e-440a-b8c5-6a6d58498258 with Priority: HIGHEST for action port [ 928.609420] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_rules [ 928.609550] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 928.609646] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24426e2-c96e-440a-b8c5-6a6d58498258 with Priority: HIGHEST for action port [ 928.609924] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.610948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.612856] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.612984] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.613424] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-e24426e2-c96e-440a-b8c5-6a6d58498258 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.613536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e24426e2-c96e-440a-b8c5-6a6d58498258" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.613603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e24426e2-c96e-440a-b8c5-6a6d58498258" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.613788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e24426e2-c96e-440a-b8c5-6a6d58498258" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.613870] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e24426e2-c96e-440a-b8c5-6a6d58498258',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.659129] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: SUCCESS [ 928.659344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.659509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.659725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.659902] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.660036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.660105] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.660278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.660361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.660459] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.683187] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.683322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.683392] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.683645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.683738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.683840] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 is going to be deleted. [ 928.731716] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.731716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.731716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.731716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.731716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.731716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.098030] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.098186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.098186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.098395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.098486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.098688] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.098788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.098852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.099018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.099102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.099226] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 is going to be deleted. [ 929.117067] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e24426e2-c96e-440a-b8c5-6a6d58498258 with status ACTIVE [ 929.117308] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.117448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.117521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.117780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.117813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.118075] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.118184] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.118216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.118374] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.118453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.118639] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.118733] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.118794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.118943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.119025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.119112] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e24426e2-c96e-440a-b8c5-6a6d58498258 is going to be updated. [ 929.125752] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.125900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.125941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.126166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.126260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.126359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.126517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.126660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.127327] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.127327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.127327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.127510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.127547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.127626] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe058e6-1ee1-46bc-bd88-8e66f89cb196',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.136716] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.136844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.136891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.137079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.137213] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.137368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e24426e2-c96e-440a-b8c5-6a6d58498258" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.166337] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.630328] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.630650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.630650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.630820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.631031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.631135] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.631236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.631308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.631462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.631539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.631639] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe058e6-1ee1-46bc-bd88-8e66f89cb196 already deleted. [ 929.631721] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe058e6-1ee1-46bc-bd88-8e66f89cb196" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.670955] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.174597] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.174846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.174969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.175210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.175329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.175453] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc is going to be updated. [ 930.217745] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.218137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.218330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.218562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.218770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.227465] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: IN_PROGRESS for 2s [ 932.247550] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: SUCCESS [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.247550] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.247550] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.247550] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.247550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.248681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.248681] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.248681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.248681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.248681] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.248681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.248681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.248681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.248681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.248681] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.748669] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd722ad1-4b5d-44e6-b813-2502626f7fdc: rpc.has_security_group_logging(os_id): False [ 932.749852] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.768535] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.769172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.769255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.769509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.769604] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.769828] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.770206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.770206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.770206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.770328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.770411] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.770506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.770558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.770695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.770767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.770948] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.771246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.771338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.771509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.771618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.771740] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc is going to be created. [ 932.833328] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.833481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.833559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.833864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.834116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.846887] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: IN_PROGRESS for 2s [ 933.256755] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.610972] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 933.611126] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 933.759152] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.759314] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.759389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.759618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.759710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.759810] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc is going to be updated. [ 933.788280] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.788440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.788512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.788716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.788859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.796289] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: IN_PROGRESS for 2s [ 934.857953] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: SUCCESS [ 934.858297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.858297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.859029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.859029] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.361786] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.361786] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.615463] env[69647]: INFO networking_nsxv3.common.synchronization [req-c790eaeb-6f91-4e96-89eb-f8168cda022c req-cda9c932-0aa4-47a8-a1ae-3dcbc7aa3531 tempest-ServersAdminTestJSON-1923625429 tempest-ServersAdminTestJSON-1923625429-project-member] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 935.616014] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 935.616405] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.616553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.616622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.616820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.616983] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.617094] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.617157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.617315] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.617386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.617479] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.806336] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: SUCCESS [ 935.806555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.806725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.806947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.807177] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.807302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.807370] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.807526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.807605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.807700] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.119557] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.309996] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.545051] env[69647]: INFO networking_nsxv3.common.synchronization [req-d316e161-76d7-40eb-b865-66a241fde0a2 req-ac1b3b41-55f4-41b2-82de-0a71f8b3becf tempest-ServerGroupTestJSON-1425258923 tempest-ServerGroupTestJSON-1425258923-project-member] Enqueued Resource ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f with Priority: HIGHEST for action security_group_members [ 936.545730] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f with Priority: HIGHEST for action security_group_members [ 936.546770] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.546906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.546973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.547229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.547391] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.547491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.547560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.547709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.547789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.547927] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.622976] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.812883] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.947519] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.947804] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.948034] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.948432] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.948796] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.949124] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.949331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.949627] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.950628] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.950628] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.950628] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.950862] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.951054] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.951313] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.951531] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.951793] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.972768] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.973008] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 936.973182] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.973361] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-943" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.973685] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-7fbde502-d40e-400d-83f5-71c7d3cf43ec taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.973889] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-7fbde502-d40e-400d-83f5-71c7d3cf43ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.974023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-7fbde502-d40e-400d-83f5-71c7d3cf43ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.974361] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-7fbde502-d40e-400d-83f5-71c7d3cf43ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.974500] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fbde502-d40e-400d-83f5-71c7d3cf43ec',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.050896] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.051175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.051255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.051520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.051634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.051921] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.052060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.052144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.053020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.053020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.053020] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f already deleted. [ 937.053020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.125520] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.125980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.126117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.126353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.126449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.126552] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 937.154316] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.154557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.154557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.154760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.154912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.164784] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 937.317457] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.317679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.317752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.317988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.318172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.318266] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc is going to be updated. [ 937.348229] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.348509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.349866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.349866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.349866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.358374] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: IN_PROGRESS for 2s [ 937.477257] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.477467] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.477562] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.477849] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.478182] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.478370] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 7fbde502-d40e-400d-83f5-71c7d3cf43ec not found, creating... [ 937.478641] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.478801] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.478920] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.479173] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.479316] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.479594] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.479753] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.479892] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.480132] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.480272] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.480414] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 7fbde502-d40e-400d-83f5-71c7d3cf43ec is going to be created. [ 937.498825] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.499089] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.499232] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.499497] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.499722] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.499968] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-7fbde502-d40e-400d-83f5-71c7d3cf43ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.423906] env[69647]: INFO networking_nsxv3.common.synchronization [req-d316e161-76d7-40eb-b865-66a241fde0a2 req-6831dc80-be5c-425a-aacf-eef781c3fc8b service nova] Enqueued Resource ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f with Priority: HIGHEST for action security_group_rules [ 938.425130] env[69647]: INFO networking_nsxv3.common.synchronization [req-d316e161-76d7-40eb-b865-66a241fde0a2 req-6831dc80-be5c-425a-aacf-eef781c3fc8b service nova] Enqueued Resource ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f with Priority: HIGHEST for action security_group_members [ 938.425130] env[69647]: INFO networking_nsxv3.common.synchronization [req-d316e161-76d7-40eb-b865-66a241fde0a2 req-6831dc80-be5c-425a-aacf-eef781c3fc8b service nova] Enqueued Resource ID: 7fbde502-d40e-400d-83f5-71c7d3cf43ec with Priority: HIGHEST for action port [ 938.425415] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f with Priority: HIGHEST for action security_group_rules [ 938.425415] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f with Priority: HIGHEST for action security_group_members [ 938.425487] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fbde502-d40e-400d-83f5-71c7d3cf43ec with Priority: HIGHEST for action port [ 938.426464] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.426464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.426464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.426464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.426714] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.427808] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.427808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.427808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.427808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.428271] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.428271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.428271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.428271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.428495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.428495] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.429234] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fbde502-d40e-400d-83f5-71c7d3cf43ec taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.429366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fbde502-d40e-400d-83f5-71c7d3cf43ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.430097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fbde502-d40e-400d-83f5-71c7d3cf43ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.430097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fbde502-d40e-400d-83f5-71c7d3cf43ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.430097] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fbde502-d40e-400d-83f5-71c7d3cf43ec',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.932428] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.932580] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.932763] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.933725] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7fbde502-d40e-400d-83f5-71c7d3cf43ec with status ACTIVE [ 938.933955] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.934055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.934120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.934414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.934568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.934763] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.934864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.934939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.935115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.935218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.935382] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.935472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.935529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.935711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.935777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.935864] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7fbde502-d40e-400d-83f5-71c7d3cf43ec is going to be updated. [ 938.956403] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.956554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.956634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.956794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.956930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.957104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fbde502-d40e-400d-83f5-71c7d3cf43ec" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.173625] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 939.173850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.367879] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: SUCCESS [ 939.368142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.368344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.368587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.368798] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.368930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.369107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.369304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.369393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.369506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.369605] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.439170] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.872581] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.872954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.873196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.876024] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.876024] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.876024] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.876024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.876024] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.883817] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.883817] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.883817] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.884173] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.884878] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.884878] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.884878] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.885151] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.885412] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.885620] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.885795] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 939.885965] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 939.886137] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 939.886314] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 939.886457] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 939.886716] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 939.906703] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 939.906897] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 939.907058] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 939.907248] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.907566] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-46a71ed7-2cb5-4ada-a0df-94864c0679bf taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.907762] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.908044] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.908333] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.908585] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a71ed7-2cb5-4ada-a0df-94864c0679bf',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.941923] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.941923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.941923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.941923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.942266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.942266] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f is going to be created. [ 939.967600] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.967600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.967886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.967886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.968070] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.976149] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f in Status: UNINITIALIZED for 2s [ 940.380256] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd722ad1-4b5d-44e6-b813-2502626f7fdc: rpc.has_security_group_logging(os_id): False [ 940.396866] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.397030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.397106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.397674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.397674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.397674] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.397959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.397959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.398041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.398136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.398298] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.398421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.398486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.398624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.398713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.398945] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.399068] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.399128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.399323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.399397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.399447] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc is going to be updated. [ 940.412643] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.412643] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.412643] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.412643] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.412643] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.412996] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.413119] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.413252] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.413489] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.413624] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.413922] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.414195] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.414271] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.414459] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.414611] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.414727] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 46a71ed7-2cb5-4ada-a0df-94864c0679bf is going to be updated. [ 940.431490] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.431803] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.431913] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.432309] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.432569] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.432883] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.455181] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.455532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.455532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.456576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.456576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.468860] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: IN_PROGRESS for 2s [ 941.205182] env[69647]: INFO networking_nsxv3.common.synchronization [req-1d9dfb57-e87a-4eac-9a60-e17999c25710 req-9ce6bf94-f6a6-4a8b-8efc-f917529048ad tempest-ListServersNegativeTestJSON-225317695 tempest-ListServersNegativeTestJSON-225317695-project-member] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 941.205720] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 941.206898] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.206898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.206898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.206898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.206898] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.206898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.206898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.206898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.206898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.207400] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.603015] env[69647]: INFO networking_nsxv3.common.synchronization [req-567975e2-01dc-4cff-99de-c10019ff0b40 req-8bb50842-23e0-4603-8522-399301417b56 service nova] Enqueued Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_rules [ 941.603264] env[69647]: INFO networking_nsxv3.common.synchronization [req-567975e2-01dc-4cff-99de-c10019ff0b40 req-8bb50842-23e0-4603-8522-399301417b56 service nova] Enqueued Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_members [ 941.603352] env[69647]: INFO networking_nsxv3.common.synchronization [req-567975e2-01dc-4cff-99de-c10019ff0b40 req-8bb50842-23e0-4603-8522-399301417b56 service nova] Enqueued Resource ID: 46a71ed7-2cb5-4ada-a0df-94864c0679bf with Priority: HIGHEST for action port [ 941.603599] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_rules [ 941.603725] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_members [ 941.603819] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a71ed7-2cb5-4ada-a0df-94864c0679bf with Priority: HIGHEST for action port [ 941.604376] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.604503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.604601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.604758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.604838] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.607317] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-63aea974-cdb8-4b5a-9001-4a1c99d2d349 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.607422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.607466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.607611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.607761] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.607894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.607944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.608223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.608273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.608351] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.609442] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-46a71ed7-2cb5-4ada-a0df-94864c0679bf taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.609442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.609587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.609650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.609729] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a71ed7-2cb5-4ada-a0df-94864c0679bf',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.711037] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.985754] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f in Status: SUCCESS [ 941.985921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.986056] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.986300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.986531] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.986607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.986661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.986827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.986929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.987034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.987129] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.112552] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-63aea974-cdb8-4b5a-9001-4a1c99d2d349 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.112685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.112920] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.113823] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46a71ed7-2cb5-4ada-a0df-94864c0679bf with status ACTIVE [ 942.114071] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.114223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.114286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.114484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.114570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.114739] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.114829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.114889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.115054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.115124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.115305] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.115394] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.115482] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.115584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.115656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.115738] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46a71ed7-2cb5-4ada-a0df-94864c0679bf is going to be updated. [ 942.135466] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.135624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.135667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.135861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.135999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.136169] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46a71ed7-2cb5-4ada-a0df-94864c0679bf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.213028] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.480936] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: SUCCESS [ 942.481299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.481383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.481676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.481676] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.488913] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.489555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.489875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.490691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.490691] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.491012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.491012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.491239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.491347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.491453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.491613] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.491738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.491780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.492182] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.492255] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.492360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.492536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.492592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.492669] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.492751] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.492844] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.618215] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.715829] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.715829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.715829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.715829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.716119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.716237] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc is going to be updated. [ 942.766635] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.767776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.767776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.767776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.767946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.783222] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: IN_PROGRESS for 2s [ 942.984112] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.984362] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.998082] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f: rpc.has_security_group_logging(os_id): False [ 943.013989] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.014203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.014203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.014783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.014783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.014783] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.014783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.015113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.015113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.015113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.015261] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.015323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.015371] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.016647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.016647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.016647] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.016647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.016647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.016647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.016647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.016647] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f is going to be created. [ 943.069901] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.069901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.069901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.070338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.070338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.080530] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f in Status: IN_PROGRESS for 2s [ 943.123422] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.123422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.123422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.123422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.123422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.123422] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 is going to be updated. [ 943.166017] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.166017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.166017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.166017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.166017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.188232] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 in Status: IN_PROGRESS for 2s [ 944.793132] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: SUCCESS [ 944.793430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.793430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.793586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.793791] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.793970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.793970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.794177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.794270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.794376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.794456] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.091605] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f in Status: SUCCESS [ 945.091987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.197349] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 in Status: SUCCESS [ 945.197660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.197919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.198255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.198469] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.198609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.198664] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.198858] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.198954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.199110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.199202] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.300119] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.300119] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.300119] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.300119] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.300119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.300883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.300883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.300883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.300883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.300883] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.701184] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.803929] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd722ad1-4b5d-44e6-b813-2502626f7fdc: rpc.has_security_group_logging(os_id): False [ 945.821700] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.821837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.821928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.822170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.822322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.822463] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.822562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.822622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.822790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.822863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.823074] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.823140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.823193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.823345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.823523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.823613] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.823722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.823722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.826768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.826768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.826768] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc is going to be updated. [ 945.882137] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.882137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.882137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.882137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.882137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.893214] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: IN_PROGRESS for 2s [ 945.943695] env[69647]: INFO networking_nsxv3.common.synchronization [req-731f1f02-c3ae-460f-8c92-a4bbbbd030ba req-5438fc1c-81a3-4860-b107-a2c4a57ab4ba tempest-ImagesTestJSON-954996409 tempest-ImagesTestJSON-954996409-project-member] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 945.944435] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 945.944753] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.944881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.944960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.949271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.949271] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.949271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.949271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.949271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.949271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.949271] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.203827] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63aea974-cdb8-4b5a-9001-4a1c99d2d349: rpc.has_security_group_logging(os_id): False [ 946.228107] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.228107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.228107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.228107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.249545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.250033] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.250413] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.250519] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.250764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.250889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.251039] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 is going to be updated. [ 946.313087] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.313280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.313397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.313535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.313713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.327612] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 in Status: IN_PROGRESS for 2s [ 946.450517] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.545673] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-984 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.545673] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.545673] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.545906] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.547226] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.547226] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.547226] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.547226] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.547226] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.547226] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.547226] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.547226] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.547541] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.547541] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.547597] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.547711] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.565030] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.565183] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.565331] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.565514] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.566067] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-4da98447-1c67-4e9c-a5db-60a2fba11c8e taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.566186] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-4da98447-1c67-4e9c-a5db-60a2fba11c8e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.566229] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-4da98447-1c67-4e9c-a5db-60a2fba11c8e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.566569] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-4da98447-1c67-4e9c-a5db-60a2fba11c8e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.566774] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4da98447-1c67-4e9c-a5db-60a2fba11c8e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.957424] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.071094] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.071374] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.071595] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.071965] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.072154] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.072327] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 4da98447-1c67-4e9c-a5db-60a2fba11c8e not found, creating... [ 947.072692] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.072877] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.073036] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.073509] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.073509] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.074819] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.074819] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.074819] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.074819] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.075048] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.075118] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 4da98447-1c67-4e9c-a5db-60a2fba11c8e is going to be created. [ 947.095398] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.095725] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.096040] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.096565] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.096565] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.096907] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-4da98447-1c67-4e9c-a5db-60a2fba11c8e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.463681] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.463896] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.463896] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.464219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.464329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.464449] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 947.495814] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.495814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.495814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.496238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.496238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.506209] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 947.842208] env[69647]: INFO networking_nsxv3.common.synchronization [req-731f1f02-c3ae-460f-8c92-a4bbbbd030ba req-da5a61aa-bb3e-4567-b1d2-c101244ad499 service nova] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_rules [ 947.842208] env[69647]: INFO networking_nsxv3.common.synchronization [req-731f1f02-c3ae-460f-8c92-a4bbbbd030ba req-da5a61aa-bb3e-4567-b1d2-c101244ad499 service nova] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 947.842208] env[69647]: INFO networking_nsxv3.common.synchronization [req-731f1f02-c3ae-460f-8c92-a4bbbbd030ba req-da5a61aa-bb3e-4567-b1d2-c101244ad499 service nova] Enqueued Resource ID: 4da98447-1c67-4e9c-a5db-60a2fba11c8e with Priority: HIGHEST for action port [ 947.842208] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_rules [ 947.845476] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 947.845476] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4da98447-1c67-4e9c-a5db-60a2fba11c8e with Priority: HIGHEST for action port [ 947.845476] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.845476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.845476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.845476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.845476] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.850508] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.850705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.850871] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-4da98447-1c67-4e9c-a5db-60a2fba11c8e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.851140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4da98447-1c67-4e9c-a5db-60a2fba11c8e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.851140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4da98447-1c67-4e9c-a5db-60a2fba11c8e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.851337] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4da98447-1c67-4e9c-a5db-60a2fba11c8e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.852017] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4da98447-1c67-4e9c-a5db-60a2fba11c8e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.917529] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: SUCCESS [ 947.918428] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.340813] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 in Status: SUCCESS [ 948.341566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.357274] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.357984] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.358352] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4da98447-1c67-4e9c-a5db-60a2fba11c8e with status ACTIVE [ 948.358875] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.359757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.360168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.360748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.360748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.360748] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.360896] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.360924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.362032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.362032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.362032] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.362198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.362328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.362978] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.362978] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.362978] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4da98447-1c67-4e9c-a5db-60a2fba11c8e is going to be updated. [ 948.384252] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.384425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.384532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.384700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.385014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.385258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4da98447-1c67-4e9c-a5db-60a2fba11c8e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.515748] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 949.516096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.516222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.516514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.516717] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.516873] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.517049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.517302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.517429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.517543] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.022321] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.517383] env[69647]: INFO networking_nsxv3.common.synchronization [req-8cd7eaee-1900-45f2-a358-884b72b409ca req-b12d1b78-6575-4005-9a65-dca50748952c tempest-ServerGroupTestJSON-1425258923 tempest-ServerGroupTestJSON-1425258923-project-member] Enqueued Resource ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f with Priority: HIGHEST for action security_group_members [ 950.519107] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f with Priority: HIGHEST for action security_group_members [ 950.521622] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.521817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.521961] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.522272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.522497] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.522637] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.522728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.522960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.523403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.524281] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.526026] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.028561] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.028748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.028861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.032413] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.032549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.034059] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.034059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.034059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.034059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.034059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.034059] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f is going to be updated. [ 951.034514] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.034614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.034671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.034826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.034900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.035074] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 951.066720] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.066857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.067008] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.067126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.067273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.068922] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.069638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.070334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.070499] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.070759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.079600] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 951.080364] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f in Status: IN_PROGRESS for 2s [ 952.537388] env[69647]: INFO networking_nsxv3.common.synchronization [req-f12b1d58-d171-477d-964f-d1977bb67238 req-1e05ef80-7814-4cc5-b1ff-e086f45d4a67 tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 952.538082] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 952.538424] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.538548] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.539065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.539065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.539065] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.539273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.539273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.539377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.539474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.539570] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.046028] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.046028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.046028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.046028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.046028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.046588] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.046867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.047028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.047306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.048879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.048879] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 953.050906] env[69647]: INFO networking_nsxv3.common.synchronization [req-eb410a6e-42c8-4482-bc92-d4f6979d8986 req-b88fdd7e-4150-4cbf-9e30-cbe2a19012cd tempest-ServerActionsTestOtherB-626642147 tempest-ServerActionsTestOtherB-626642147-project-member] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 953.052521] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 953.053685] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.053950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.054124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.054402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.054643] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.054960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.055171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.056391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.056391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.056391] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.085149] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.085548] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.085767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.086110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.086357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.102032] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 953.103420] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 953.103691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.104049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.104338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.105528] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.105528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.105528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.105528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.105528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.105528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.105528] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.108729] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f in Status: SUCCESS [ 953.108973] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f deletion is rescheduled due to dependency. [ 953.109088] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.211746] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.212011] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.212178] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.212470] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.212819] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.213212] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.213774] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.213928] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.214094] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.214582] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.214739] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.215008] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.215209] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.215367] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 953.215591] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.215851] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.240638] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.240638] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 953.240798] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.240868] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.242620] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-6d1b54c9-21ac-4a12-81f2-7a9bb02fae92 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.242620] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-6d1b54c9-21ac-4a12-81f2-7a9bb02fae92" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.242820] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-6d1b54c9-21ac-4a12-81f2-7a9bb02fae92" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.243507] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-6d1b54c9-21ac-4a12-81f2-7a9bb02fae92" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.243507] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d1b54c9-21ac-4a12-81f2-7a9bb02fae92',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.558082] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.558605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.558605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.558605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.588601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.588868] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.589716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.589716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.589716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.589716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.589716] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be updated. [ 953.609572] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.609715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.609828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.610141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.610666] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.610666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.610666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.610666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.610910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.610910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.610961] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.611200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.611258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.611413] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.611553] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.611647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.611707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.611960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.612059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.612270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.612311] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.620706] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.620847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.620917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.621151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.621277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.632691] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 953.747669] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.747833] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.747966] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.748314] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.748575] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.748832] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 6d1b54c9-21ac-4a12-81f2-7a9bb02fae92 not found, creating... [ 953.749031] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.749202] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.749329] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.749580] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.749722] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.750740] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.750930] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.751068] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.751350] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.751500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.751699] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 6d1b54c9-21ac-4a12-81f2-7a9bb02fae92 is going to be created. [ 953.773015] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.773312] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.773445] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.774008] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.774446] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.774831] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-6d1b54c9-21ac-4a12-81f2-7a9bb02fae92" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.114685] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac810154-f096-4495-a2c8-d43e5bb3d1a2: rpc.has_security_group_logging(os_id): False [ 954.133792] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.134606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.134606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.134606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.134606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.134606] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.135326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.135326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.135326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.135326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.135326] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.135326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.135326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.135587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.135587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.136107] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.136107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.136107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.136107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.136107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.137277] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 954.232375] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.232375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.232375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.232375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.232375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.257495] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 954.760421] env[69647]: INFO networking_nsxv3.common.synchronization [req-f12b1d58-d171-477d-964f-d1977bb67238 req-294ceae6-2712-4732-b404-bff5580f7183 service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 954.760792] env[69647]: INFO networking_nsxv3.common.synchronization [req-f12b1d58-d171-477d-964f-d1977bb67238 req-294ceae6-2712-4732-b404-bff5580f7183 service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 954.761794] env[69647]: INFO networking_nsxv3.common.synchronization [req-f12b1d58-d171-477d-964f-d1977bb67238 req-294ceae6-2712-4732-b404-bff5580f7183 service nova] Enqueued Resource ID: 6d1b54c9-21ac-4a12-81f2-7a9bb02fae92 with Priority: HIGHEST for action port [ 954.762629] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 954.762782] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 954.762915] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d1b54c9-21ac-4a12-81f2-7a9bb02fae92 with Priority: HIGHEST for action port [ 954.763737] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.763908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.763994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.764279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.764399] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.766425] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.766635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.766945] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d1b54c9-21ac-4a12-81f2-7a9bb02fae92 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.767326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d1b54c9-21ac-4a12-81f2-7a9bb02fae92" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.767463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d1b54c9-21ac-4a12-81f2-7a9bb02fae92" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.767800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d1b54c9-21ac-4a12-81f2-7a9bb02fae92" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.767928] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d1b54c9-21ac-4a12-81f2-7a9bb02fae92',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.104086] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec290612-a441-43a3-96c1-fe5d65e4a1eb req-95f26132-6d21-4291-9e39-b86c115500e0 tempest-ServerRescueNegativeTestJSON-41623176 tempest-ServerRescueNegativeTestJSON-41623176-project-member] Enqueued Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_members [ 955.105062] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_members [ 955.105774] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.105918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.105987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.106303] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.106569] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.106743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.106815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.107018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.107139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.107253] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deec7c2d-a3e1-4f84-97a5-b5433b7b69ff',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.118842] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 955.119059] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 deletion is rescheduled due to dependency. [ 955.119175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.119336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.119541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.119750] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.119915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.119977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.120183] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.120263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.120365] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.270238] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.270358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.274411] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d1b54c9-21ac-4a12-81f2-7a9bb02fae92 with status ACTIVE [ 955.274624] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.274763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.274833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.275096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.275246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.275435] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.275538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.275716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.275763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.275834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.277840] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.278036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.278158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.278300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.278351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.278493] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d1b54c9-21ac-4a12-81f2-7a9bb02fae92 is going to be updated. [ 955.305058] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.307203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.307203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.307203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.307203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.307203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d1b54c9-21ac-4a12-81f2-7a9bb02fae92" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.495926] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.496230] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.496366] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.496728] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.497396] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.497807] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.498024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.498329] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.498667] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.498978] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.499188] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.499352] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.499536] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.499906] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 955.500231] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.500446] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.520761] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.521084] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 955.521287] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.521569] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-457" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.522021] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-0c464bb5-2c6a-4e9b-9046-30a4c4568daf taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.522266] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-0c464bb5-2c6a-4e9b-9046-30a4c4568daf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.522446] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-0c464bb5-2c6a-4e9b-9046-30a4c4568daf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.522877] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-0c464bb5-2c6a-4e9b-9046-30a4c4568daf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.523330] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c464bb5-2c6a-4e9b-9046-30a4c4568daf',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.548932] env[69647]: INFO networking_nsxv3.common.synchronization [req-dacac6f6-9b23-4a68-9b8d-2a2017fe1f00 req-76b5b68d-0bfa-4991-8c11-d1f55b399c5f tempest-ServersWithSpecificFlavorTestJSON-1052584011 tempest-ServersWithSpecificFlavorTestJSON-1052584011-project-member] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 955.549585] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGHEST for action security_group_members [ 955.549916] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.550595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.550595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.551119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.551119] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.551372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.551372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.551726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.551813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.552279] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.610327] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.610495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.610549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.610766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.610855] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.611191] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.611191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.611191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.611454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.611454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.611506] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff already deleted. [ 955.611588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.623350] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.642387] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 955.642565] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 deletion is rescheduled due to dependency. [ 955.642682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.029030] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.029030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.029030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.029030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.029030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.029030] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 0c464bb5-2c6a-4e9b-9046-30a4c4568daf not found, creating... [ 956.029030] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.029030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.029030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.029030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.029030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.031128] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.031558] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.031917] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.032491] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.034408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.034408] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 0c464bb5-2c6a-4e9b-9046-30a4c4568daf is going to be created. [ 956.054060] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.054060] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.055689] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.055689] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.055689] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.056506] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-0c464bb5-2c6a-4e9b-9046-30a4c4568daf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.060045] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.060045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.060045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.060045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.060045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.060045] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.060045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.060045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.060045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.060045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.060045] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f is going to be updated. [ 956.086675] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.086675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.086675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.086675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.086675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.095159] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: IN_PROGRESS for 2s [ 956.125856] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.273883] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 956.273883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.629082] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.629437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.629525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.629743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.630280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.630395] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 956.656654] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.656813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.656884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.657183] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.657357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.667351] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 956.825400] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec290612-a441-43a3-96c1-fe5d65e4a1eb req-c750a0b6-bf79-4ec4-b4de-4ca56960203e service nova] Enqueued Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_rules [ 956.826902] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec290612-a441-43a3-96c1-fe5d65e4a1eb req-c750a0b6-bf79-4ec4-b4de-4ca56960203e service nova] Enqueued Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_members [ 956.826902] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec290612-a441-43a3-96c1-fe5d65e4a1eb req-c750a0b6-bf79-4ec4-b4de-4ca56960203e service nova] Enqueued Resource ID: 0c464bb5-2c6a-4e9b-9046-30a4c4568daf with Priority: HIGHEST for action port [ 956.827387] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_rules [ 956.829014] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_members [ 956.829014] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c464bb5-2c6a-4e9b-9046-30a4c4568daf with Priority: HIGHEST for action port [ 956.829014] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.829014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.829334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.829334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.829390] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('deec7c2d-a3e1-4f84-97a5-b5433b7b69ff',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.830278] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.830625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.830625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.830625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.830805] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.830864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.830914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.831070] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.831138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.831511] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deec7c2d-a3e1-4f84-97a5-b5433b7b69ff',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.832019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c464bb5-2c6a-4e9b-9046-30a4c4568daf taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.832110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c464bb5-2c6a-4e9b-9046-30a4c4568daf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.832773] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c464bb5-2c6a-4e9b-9046-30a4c4568daf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.832773] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c464bb5-2c6a-4e9b-9046-30a4c4568daf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.832773] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c464bb5-2c6a-4e9b-9046-30a4c4568daf',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.334582] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.334582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.334866] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('deec7c2d-a3e1-4f84-97a5-b5433b7b69ff',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.335752] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c464bb5-2c6a-4e9b-9046-30a4c4568daf with status ACTIVE [ 957.335992] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.336299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.336299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.336430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.336515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.336680] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.336772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.336832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.336970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.341264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.341545] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.341794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.341794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.341917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.341977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.342089] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c464bb5-2c6a-4e9b-9046-30a4c4568daf is going to be updated. [ 957.361814] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.361992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.362048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.362235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.362384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.362568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c464bb5-2c6a-4e9b-9046-30a4c4568daf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.843884] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('deec7c2d-a3e1-4f84-97a5-b5433b7b69ff',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.105213] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f in Status: SUCCESS [ 958.105397] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f deletion is rescheduled due to dependency. [ 958.105516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.346436] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.347021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.347071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.347362] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.347464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.347575] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff is going to be created. [ 958.370307] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.370307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.370307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.370307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.370307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.379864] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff in Status: UNINITIALIZED for 2s [ 958.677104] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 958.677104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.677359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.677521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.677754] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.677929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.677929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.678096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.678152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.678240] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.678334] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.180386] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.180535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.180618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.180850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.181038] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.181155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.181219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.181386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.181475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.181562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.181726] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.181820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.181879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.182059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.182200] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.182369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.182369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.182496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.182570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.182660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.182763] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.687072] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 326bee86-2025-4239-98be-95f9262ac7a3: rpc.has_security_group_logging(os_id): False [ 959.707022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.707022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.707022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.707022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.707614] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.707614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.707614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.707614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.707614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.707614] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 959.768222] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.768222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.768222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.768222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.768222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.778846] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 959.994122] env[69647]: INFO networking_nsxv3.common.synchronization [req-c4023a6f-a9d6-4d55-bd98-3207f625460f req-766c4928-6d6a-4b3c-81a4-e5cc0af27a59 tempest-MultipleCreateTestJSON-207473124 tempest-MultipleCreateTestJSON-207473124-project-member] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 959.994122] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 959.994122] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.994122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.994122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.994122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.994122] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.994122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.994122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.994122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.994122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.995607] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.295065] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.295291] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.295420] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.299027] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.299027] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.299027] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.299027] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.299027] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.299027] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.299027] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.299027] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.299027] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.299027] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.299027] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.299027] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.299027] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.318077] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.318077] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.320437] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.320682] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.321136] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-9ed8ce06-ef9e-4496-bbab-7cfc43e80d73 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.321448] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-9ed8ce06-ef9e-4496-bbab-7cfc43e80d73" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.321563] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-9ed8ce06-ef9e-4496-bbab-7cfc43e80d73" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.321957] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-9ed8ce06-ef9e-4496-bbab-7cfc43e80d73" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.322107] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ed8ce06-ef9e-4496-bbab-7cfc43e80d73',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.394019] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff in Status: SUCCESS [ 960.394019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.394019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.394019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.394019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.394019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.394019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.394019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.394019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.394019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.394019] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('deec7c2d-a3e1-4f84-97a5-b5433b7b69ff',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.497445] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.497640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.497762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.498101] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.498240] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.498589] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.498708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.498772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.498945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.499048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.499141] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be updated. [ 960.524531] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.524744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.524786] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.525057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.526641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.535696] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 960.601763] env[69647]: INFO networking_nsxv3.common.synchronization [req-e3c1a794-ffad-48bc-9e21-ff755e097460 req-08183e06-33da-4774-80df-64acb1465550 tempest-AttachVolumeTestJSON-1527312667 tempest-AttachVolumeTestJSON-1527312667-project-member] Enqueued Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_members [ 960.602404] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGHEST for action security_group_members [ 960.602764] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-80142545-bab7-4367-b0e0-40b8e04f4503 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.602893] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.602975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.605706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.605891] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.606014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.606090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.606257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.606343] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.606463] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.825621] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.825924] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.825960] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.826316] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.826476] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.826658] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 9ed8ce06-ef9e-4496-bbab-7cfc43e80d73 not found, creating... [ 960.826895] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.827076] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.827198] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.827427] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.827570] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.827884] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.828009] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.828691] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.828919] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.829084] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.829223] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 9ed8ce06-ef9e-4496-bbab-7cfc43e80d73 is going to be created. [ 960.848388] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.848767] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.849574] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.849574] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.849888] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.849973] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-9ed8ce06-ef9e-4496-bbab-7cfc43e80d73" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.896545] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('deec7c2d-a3e1-4f84-97a5-b5433b7b69ff',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.109488] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.109637] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.109709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.109949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.110063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.110262] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.110363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.110428] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.110588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.110666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.110753] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80142545-bab7-4367-b0e0-40b8e04f4503 is going to be updated. [ 961.134246] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.134457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.134457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.134652] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.134797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.142426] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80142545-bab7-4367-b0e0-40b8e04f4503 in Status: IN_PROGRESS for 2s [ 961.399354] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for deec7c2d-a3e1-4f84-97a5-b5433b7b69ff: rpc.has_security_group_logging(os_id): False [ 961.417149] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.417561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.417803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.418672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.418672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.418672] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.418924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.418924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.419095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.419228] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.419372] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff is going to be created. [ 961.478155] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.478155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.478155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.478155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.478155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.488154] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff in Status: IN_PROGRESS for 2s [ 961.603388] env[69647]: INFO networking_nsxv3.common.synchronization [req-c4023a6f-a9d6-4d55-bd98-3207f625460f req-1dd37ecc-e029-4933-b011-be620dda9204 service nova] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_rules [ 961.603571] env[69647]: INFO networking_nsxv3.common.synchronization [req-c4023a6f-a9d6-4d55-bd98-3207f625460f req-1dd37ecc-e029-4933-b011-be620dda9204 service nova] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 961.604067] env[69647]: INFO networking_nsxv3.common.synchronization [req-c4023a6f-a9d6-4d55-bd98-3207f625460f req-1dd37ecc-e029-4933-b011-be620dda9204 service nova] Enqueued Resource ID: 9ed8ce06-ef9e-4496-bbab-7cfc43e80d73 with Priority: HIGHEST for action port [ 961.604067] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_rules [ 961.604175] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 961.604261] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ed8ce06-ef9e-4496-bbab-7cfc43e80d73 with Priority: HIGHEST for action port [ 961.604790] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.604932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.604996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.605851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.605851] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.606659] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.606709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.606891] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ed8ce06-ef9e-4496-bbab-7cfc43e80d73 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.607047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ed8ce06-ef9e-4496-bbab-7cfc43e80d73" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.607092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ed8ce06-ef9e-4496-bbab-7cfc43e80d73" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.607232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ed8ce06-ef9e-4496-bbab-7cfc43e80d73" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.607342] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ed8ce06-ef9e-4496-bbab-7cfc43e80d73',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.791586] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 961.791821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.109332] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ed8ce06-ef9e-4496-bbab-7cfc43e80d73 with status ACTIVE [ 962.109587] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.109717] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.109756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.110184] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.110184] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.110249] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.110329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.110386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.110529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.110603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.110783] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.110875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.110936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.111141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.111263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.111392] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ed8ce06-ef9e-4496-bbab-7cfc43e80d73 is going to be updated. [ 962.113207] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.113323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.132681] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.132681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.132681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.132681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.132681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.133012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ed8ce06-ef9e-4496-bbab-7cfc43e80d73" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.466385] env[69647]: INFO networking_nsxv3.common.synchronization [req-c4023a6f-a9d6-4d55-bd98-3207f625460f req-3a2c352c-7071-4b23-9f79-7cc18b6d3359 tempest-MultipleCreateTestJSON-207473124 tempest-MultipleCreateTestJSON-207473124-project-member] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 962.466867] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 962.467261] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.467387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.545747] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 962.546151] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 deletion is rescheduled due to dependency. [ 962.546353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.546611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.546881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.547124] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.547294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.547398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.547591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.547707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.547850] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.956810] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-595 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.957304] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.957638] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.958149] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.959315] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.959688] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.959933] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.960426] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.960561] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.960803] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.961030] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.961378] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.961465] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.961695] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.962656] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.962656] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.983070] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.983289] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 962.985751] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.985751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-595" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.985751] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-3ed0d108-1dcd-4fba-a46a-02da9466dc31 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.985751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-3ed0d108-1dcd-4fba-a46a-02da9466dc31" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.985751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-3ed0d108-1dcd-4fba-a46a-02da9466dc31" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.985751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-3ed0d108-1dcd-4fba-a46a-02da9466dc31" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.985751] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed0d108-1dcd-4fba-a46a-02da9466dc31',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.050158] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.152346] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80142545-bab7-4367-b0e0-40b8e04f4503 in Status: SUCCESS [ 963.152560] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80142545-bab7-4367-b0e0-40b8e04f4503 deletion is rescheduled due to dependency. [ 963.152689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.488719] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.489125] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.489341] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.489767] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.489998] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.490228] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 3ed0d108-1dcd-4fba-a46a-02da9466dc31 not found, creating... [ 963.490559] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.490778] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.490906] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.491463] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.491629] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.492080] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.492312] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.492707] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.493084] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.493252] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.493589] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 3ed0d108-1dcd-4fba-a46a-02da9466dc31 is going to be created. [ 963.505967] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff in Status: SUCCESS [ 963.506395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.514109] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.514436] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.514619] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.514861] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.515227] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.515527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-3ed0d108-1dcd-4fba-a46a-02da9466dc31" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.552749] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.054914] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.056953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.056953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.056953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.056953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.056953] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be updated. [ 964.083157] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.083321] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.083395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.083609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.083763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.091999] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 964.281431] env[69647]: INFO networking_nsxv3.common.synchronization [req-c4023a6f-a9d6-4d55-bd98-3207f625460f req-f9386651-01b7-4502-a027-f1b2263d3cfe service nova] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_rules [ 964.281701] env[69647]: INFO networking_nsxv3.common.synchronization [req-c4023a6f-a9d6-4d55-bd98-3207f625460f req-f9386651-01b7-4502-a027-f1b2263d3cfe service nova] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 964.281738] env[69647]: INFO networking_nsxv3.common.synchronization [req-c4023a6f-a9d6-4d55-bd98-3207f625460f req-f9386651-01b7-4502-a027-f1b2263d3cfe service nova] Enqueued Resource ID: 3ed0d108-1dcd-4fba-a46a-02da9466dc31 with Priority: HIGHEST for action port [ 964.282470] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_rules [ 964.282613] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 964.282710] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed0d108-1dcd-4fba-a46a-02da9466dc31 with Priority: HIGHEST for action port [ 964.283024] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.283142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.283353] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.283441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.283610] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ed0d108-1dcd-4fba-a46a-02da9466dc31 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.283711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ed0d108-1dcd-4fba-a46a-02da9466dc31" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.283772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ed0d108-1dcd-4fba-a46a-02da9466dc31" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.283998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ed0d108-1dcd-4fba-a46a-02da9466dc31" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.284171] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed0d108-1dcd-4fba-a46a-02da9466dc31',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.786456] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ed0d108-1dcd-4fba-a46a-02da9466dc31 with status ACTIVE [ 964.786802] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.787483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.787483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.787483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.787483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.787483] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.787483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.787659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.787659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.787809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.787891] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.789269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.789269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.789269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.789269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.789269] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ed0d108-1dcd-4fba-a46a-02da9466dc31 is going to be updated. [ 964.808495] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.808642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.808716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.808918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.809111] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.811314] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ed0d108-1dcd-4fba-a46a-02da9466dc31" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.102231] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 4s [ 967.566197] env[69647]: INFO networking_nsxv3.common.synchronization [req-f2061be8-44b2-4be0-8dab-18df43fa008a req-7802c207-3855-4062-b522-51ba50184086 tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_members [ 967.566969] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_members [ 967.566969] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6168f488-7a73-4458-9cef-b4375e37e273 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.571920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.571920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.572066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.574285] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.574285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.574285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.574285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.574285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.574285] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6168f488-7a73-4458-9cef-b4375e37e273',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.968794] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.968997] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.969148] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.969481] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.969805] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.970031] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.971216] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.971536] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.971767] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.972237] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.972535] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.972805] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.973037] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.973269] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.973522] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.973744] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.992693] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.993368] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 967.993502] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.993916] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.993916] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-86a7de77-811e-42d7-977b-2fb79548e2b0 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.994273] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-86a7de77-811e-42d7-977b-2fb79548e2b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.994435] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-86a7de77-811e-42d7-977b-2fb79548e2b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.994768] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-86a7de77-811e-42d7-977b-2fb79548e2b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.994921] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86a7de77-811e-42d7-977b-2fb79548e2b0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.076313] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.076462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.076528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.076770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.076815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.078255] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.078414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.078486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.078682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.078778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.078901] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6168f488-7a73-4458-9cef-b4375e37e273 already deleted. [ 968.079012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.114016] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 968.114016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.114016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.114016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.114016] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.114016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.114016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.114016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.114016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.114016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.114397] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.115017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.115017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.115145] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.115472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.115472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.115472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.115626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.115626] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.497594] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.497850] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.498102] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.498430] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.498650] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.498853] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 86a7de77-811e-42d7-977b-2fb79548e2b0 not found, creating... [ 968.503329] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.503687] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.503812] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.504155] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.504351] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.504758] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.504980] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.505169] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.505449] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.505637] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.505836] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 86a7de77-811e-42d7-977b-2fb79548e2b0 is going to be created. [ 968.512670] env[69647]: INFO networking_nsxv3.common.synchronization [req-84a25bde-6ac1-44bb-ab00-5c6d501b717f req-2bd43392-83b9-4b99-bdd6-b0e59153f017 tempest-ImagesTestJSON-954996409 tempest-ImagesTestJSON-954996409-project-member] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 968.513535] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 968.514443] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.514616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.514752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.515098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.515704] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.515862] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.515949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.516161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.516293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.516424] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.532668] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.533176] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.533435] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.533837] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.534191] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.534479] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-86a7de77-811e-42d7-977b-2fb79548e2b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.617718] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.618064] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.622976] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.018962] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.125050] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.339145] env[69647]: INFO networking_nsxv3.common.synchronization [req-f2061be8-44b2-4be0-8dab-18df43fa008a req-d8cc9faa-fbab-4836-add8-c8a3d4774661 service nova] Enqueued Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_rules [ 969.339781] env[69647]: INFO networking_nsxv3.common.synchronization [req-f2061be8-44b2-4be0-8dab-18df43fa008a req-d8cc9faa-fbab-4836-add8-c8a3d4774661 service nova] Enqueued Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_members [ 969.339781] env[69647]: INFO networking_nsxv3.common.synchronization [req-f2061be8-44b2-4be0-8dab-18df43fa008a req-d8cc9faa-fbab-4836-add8-c8a3d4774661 service nova] Enqueued Resource ID: 86a7de77-811e-42d7-977b-2fb79548e2b0 with Priority: HIGHEST for action port [ 969.339781] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_rules [ 969.340172] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_members [ 969.340172] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86a7de77-811e-42d7-977b-2fb79548e2b0 with Priority: HIGHEST for action port [ 969.340490] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6168f488-7a73-4458-9cef-b4375e37e273 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.340608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.340671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.345042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.345042] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6168f488-7a73-4458-9cef-b4375e37e273',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.347216] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6168f488-7a73-4458-9cef-b4375e37e273 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.347432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.347517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.347814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.352019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.352019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.352019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.352019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.352019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.352019] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6168f488-7a73-4458-9cef-b4375e37e273',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.352019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-86a7de77-811e-42d7-977b-2fb79548e2b0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.352019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86a7de77-811e-42d7-977b-2fb79548e2b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.352019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86a7de77-811e-42d7-977b-2fb79548e2b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.352019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86a7de77-811e-42d7-977b-2fb79548e2b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.352019] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86a7de77-811e-42d7-977b-2fb79548e2b0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.525199] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.629783] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.629783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.629783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.629783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.629783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.629783] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be updated. [ 969.653933] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.656186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.656186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.656186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.656186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.663764] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 969.717060] env[69647]: INFO networking_nsxv3.common.synchronization [None req-cccd37d2-c094-49a0-9ec6-e8bd86461fb4 None None] Enqueued Resource ID: a0a3041e-65da-437b-8204-4c3942792fbd with Priority: HIGHEST for action port [ 969.717060] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a3041e-65da-437b-8204-4c3942792fbd with Priority: HIGHEST for action port [ 969.717060] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0a3041e-65da-437b-8204-4c3942792fbd taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.717060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0a3041e-65da-437b-8204-4c3942792fbd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.717060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0a3041e-65da-437b-8204-4c3942792fbd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.717060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0a3041e-65da-437b-8204-4c3942792fbd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.717060] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0a3041e-65da-437b-8204-4c3942792fbd',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.854397] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6168f488-7a73-4458-9cef-b4375e37e273 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.857277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.857277] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6168f488-7a73-4458-9cef-b4375e37e273',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.857277] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86a7de77-811e-42d7-977b-2fb79548e2b0 with status ACTIVE [ 969.857277] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.857277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.857277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.857277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.857277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.857277] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.857277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.857277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.857277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.857277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.857277] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.857277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.857277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.858201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.858401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.858573] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86a7de77-811e-42d7-977b-2fb79548e2b0 is going to be updated. [ 969.881156] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.881156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.881156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.881156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.881156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.881156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86a7de77-811e-42d7-977b-2fb79548e2b0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.953531] env[69647]: INFO networking_nsxv3.common.synchronization [req-7a028b14-3916-4536-88cc-a6798145085e req-effca9d5-861a-4c1e-8807-48bf7845ae66 tempest-ServersTestBootFromVolume-391508555 tempest-ServersTestBootFromVolume-391508555-project-member] Enqueued Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_members [ 969.954949] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_members [ 969.955291] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fbffbeb-5173-4e7a-966f-dee89646c2c1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.955415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.955526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.955936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.955936] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.956061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.956143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.956296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.956358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.956549] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fbffbeb-5173-4e7a-966f-dee89646c2c1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.032373] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.032543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.032613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.032818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.032902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.033104] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 970.073240] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.073421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.073496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.073702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.073848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.087182] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 970.220098] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0a3041e-65da-437b-8204-4c3942792fbd [ 970.220270] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.220426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.220494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.220699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.220767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.220864] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0a3041e-65da-437b-8204-4c3942792fbd already deleted. [ 970.220944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0a3041e-65da-437b-8204-4c3942792fbd" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.361429] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6168f488-7a73-4458-9cef-b4375e37e273',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.459462] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.459596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.459644] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.461725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.461725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.461725] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.461725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.461725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.461725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.461725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.461725] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 already deleted. [ 970.461725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.489756] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.489995] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-886" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.491058] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-886" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.491187] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-886" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.491465] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.491627] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.491744] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.491994] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.492193] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.492412] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.492512] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 970.493501] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 970.493684] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 970.493840] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 970.494116] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 970.494246] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 970.514414] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 970.514728] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 970.515055] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 970.516106] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-886" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.516412] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-5cde7105-8c5f-4654-a199-d2e3193d9c54 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.516611] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-5cde7105-8c5f-4654-a199-d2e3193d9c54" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.517238] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-5cde7105-8c5f-4654-a199-d2e3193d9c54" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.517238] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-5cde7105-8c5f-4654-a199-d2e3193d9c54" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.517238] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cde7105-8c5f-4654-a199-d2e3193d9c54',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.857449] env[69647]: INFO networking_nsxv3.common.synchronization [None req-1a79b5fc-938e-4df4-b5cf-301b32a3cca8 tempest-ServersV294TestFqdnHostnames-399989070 tempest-ServersV294TestFqdnHostnames-399989070-project-member] Enqueued Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_rules [ 970.857977] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_rules [ 970.858695] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6ff3703-4f0f-4e11-8846-e36203877107 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.858695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.858935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.858994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.859079] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.863328] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.863460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.863526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.866157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.866157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.866157] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6168f488-7a73-4458-9cef-b4375e37e273 is going to be created. [ 970.890735] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.890735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.890735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.890735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.890735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.901438] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6168f488-7a73-4458-9cef-b4375e37e273 in Status: UNINITIALIZED for 2s [ 970.940965] env[69647]: INFO networking_nsxv3.common.synchronization [req-b7e95271-b3d4-4927-8cf2-a860bc57d164 req-4c1ada8e-c77f-405f-83ac-b8370b1fbadf tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 970.940965] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 970.941245] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.941819] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.941819] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.941819] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.941819] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.942286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.942286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.942286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.942286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.942449] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.971222] env[69647]: INFO networking_nsxv3.common.synchronization [None req-7e8baac6-a7c1-444d-8ac0-7c3aff56a255 tempest-ServersV294TestFqdnHostnames-399989070 tempest-ServersV294TestFqdnHostnames-399989070-project-member] Enqueued Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_rules [ 970.971443] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_rules [ 970.973647] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6ff3703-4f0f-4e11-8846-e36203877107 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.974052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.022808] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.023155] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.023793] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.023793] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.023793] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.023918] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 5cde7105-8c5f-4654-a199-d2e3193d9c54 not found, creating... [ 971.024146] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.024340] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.024685] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.024685] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.024821] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.025147] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.025332] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.025546] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.025804] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.025957] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.027227] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 5cde7105-8c5f-4654-a199-d2e3193d9c54 is going to be created. [ 971.046830] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.046830] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.046830] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.046830] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.046830] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.046830] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-5cde7105-8c5f-4654-a199-d2e3193d9c54" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.378664] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.378810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.378871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.379123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.379209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.379304] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6ff3703-4f0f-4e11-8846-e36203877107 already deleted. [ 971.379382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.379531] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.379675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.379756] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.448570] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.448570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.448570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.448570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.448570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.448570] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.448570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.448570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.448570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.448570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.448570] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 971.472400] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.472568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.472645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.472827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.472974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.481128] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 971.673668] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 971.673911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.674087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.674307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.674465] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.674577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.674638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.674782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.674857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.674946] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.808986] env[69647]: INFO networking_nsxv3.common.synchronization [req-7a028b14-3916-4536-88cc-a6798145085e req-1490784f-764b-4fec-905f-1a4233c07904 service nova] Enqueued Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_rules [ 971.809236] env[69647]: INFO networking_nsxv3.common.synchronization [req-7a028b14-3916-4536-88cc-a6798145085e req-1490784f-764b-4fec-905f-1a4233c07904 service nova] Enqueued Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_members [ 971.809402] env[69647]: INFO networking_nsxv3.common.synchronization [req-7a028b14-3916-4536-88cc-a6798145085e req-1490784f-764b-4fec-905f-1a4233c07904 service nova] Enqueued Resource ID: 5cde7105-8c5f-4654-a199-d2e3193d9c54 with Priority: HIGHEST for action port [ 971.809667] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_rules [ 971.809804] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_members [ 971.809897] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cde7105-8c5f-4654-a199-d2e3193d9c54 with Priority: HIGHEST for action port [ 971.810882] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.810978] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.811069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.811291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.811582] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fbffbeb-5173-4e7a-966f-dee89646c2c1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.814046] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fbffbeb-5173-4e7a-966f-dee89646c2c1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.814046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.814046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.814046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.814046] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.814046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.814638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.814638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.814750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.814849] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fbffbeb-5173-4e7a-966f-dee89646c2c1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.815826] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cde7105-8c5f-4654-a199-d2e3193d9c54 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.815950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cde7105-8c5f-4654-a199-d2e3193d9c54" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.816030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cde7105-8c5f-4654-a199-d2e3193d9c54" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.819167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cde7105-8c5f-4654-a199-d2e3193d9c54" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.819167] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cde7105-8c5f-4654-a199-d2e3193d9c54',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.901848] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.902166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.902166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.902334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.902421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.906024] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6ff3703-4f0f-4e11-8846-e36203877107 already deleted. [ 971.906024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.098847] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 972.098847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.119755] env[69647]: INFO networking_nsxv3.common.synchronization [None req-7b32910b-8980-4f0c-bd4f-bda3c06d230b None None] Enqueued Resource ID: 3923c9c4-7eda-4cbf-b310-26d0d8ec2b51 with Priority: HIGHEST for action port [ 972.119755] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3923c9c4-7eda-4cbf-b310-26d0d8ec2b51 with Priority: HIGHEST for action port [ 972.119755] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3923c9c4-7eda-4cbf-b310-26d0d8ec2b51 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.119755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3923c9c4-7eda-4cbf-b310-26d0d8ec2b51" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.119755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3923c9c4-7eda-4cbf-b310-26d0d8ec2b51" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.121054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3923c9c4-7eda-4cbf-b310-26d0d8ec2b51" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.121434] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3923c9c4-7eda-4cbf-b310-26d0d8ec2b51',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.176566] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.321431] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fbffbeb-5173-4e7a-966f-dee89646c2c1 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.321560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.321752] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fbffbeb-5173-4e7a-966f-dee89646c2c1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.322640] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cde7105-8c5f-4654-a199-d2e3193d9c54 with status ACTIVE [ 972.322817] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.323236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.323236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.323236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.323377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.323485] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.323572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.323634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.323777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.323847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.324037] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.324131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.324190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.324329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.324401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.324535] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cde7105-8c5f-4654-a199-d2e3193d9c54 is going to be updated. [ 972.345810] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.346018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.346167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.346456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.346634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.346863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cde7105-8c5f-4654-a199-d2e3193d9c54" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.628133] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3923c9c4-7eda-4cbf-b310-26d0d8ec2b51 [ 972.629283] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.629283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.629283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.629283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.629283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.629283] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3923c9c4-7eda-4cbf-b310-26d0d8ec2b51 already deleted. [ 972.629283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3923c9c4-7eda-4cbf-b310-26d0d8ec2b51" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.680447] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.826356] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fbffbeb-5173-4e7a-966f-dee89646c2c1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.910807] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6168f488-7a73-4458-9cef-b4375e37e273 in Status: SUCCESS [ 972.911119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.911196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.911407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.911591] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.912252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.912252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.912252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.912252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.912252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.912252] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6168f488-7a73-4458-9cef-b4375e37e273',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.183018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.183245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.183335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.183574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.183688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.183812] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be updated. [ 973.211830] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.211830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.211830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.211830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.211830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.220074] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 973.328933] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.329813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.329813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.329813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.329813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.330052] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 is going to be created. [ 973.353306] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.353444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.353517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.353745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.353902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.363152] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 in Status: UNINITIALIZED for 2s [ 973.417348] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6168f488-7a73-4458-9cef-b4375e37e273',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.495924] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 973.496169] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 deletion is rescheduled due to dependency. [ 973.496299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.744861] env[69647]: INFO networking_nsxv3.common.synchronization [req-efdd3e41-8b9f-4300-8cfc-3e7fdc165ae7 req-1f2feef9-5040-4d98-8242-bc55215d2a8b tempest-ServersAdminTestJSON-1923625429 tempest-ServersAdminTestJSON-1923625429-project-member] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 973.744861] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 973.744994] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.744994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.745167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.745328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.745481] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.745579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.745643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.745771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.745847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.745938] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.916776] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6168f488-7a73-4458-9cef-b4375e37e273: rpc.has_security_group_logging(os_id): False [ 973.937233] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.937465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.937536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.937791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.937877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.938144] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.938310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.938310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.938555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.938637] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.938726] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6168f488-7a73-4458-9cef-b4375e37e273 is going to be created. [ 973.994808] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.996476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.996476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.996476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.996476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.005144] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6168f488-7a73-4458-9cef-b4375e37e273 in Status: IN_PROGRESS for 2s [ 974.248918] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.752979] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.232211] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 975.232460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.232571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.232787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.232971] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.233131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.233198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.233359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.233433] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.233519] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.233680] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.233774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.233835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.233975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.234128] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.234245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.234288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.234405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.234475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.234560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.234638] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.258119] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.258119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.258119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.258119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.258119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.258119] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 975.280885] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.281058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.281133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.281345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.281498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.289784] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 975.372718] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 in Status: SUCCESS [ 975.372888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.373097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.373332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.373521] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.373670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.373702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.373846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.373935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.374033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.374129] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0fbffbeb-5173-4e7a-966f-dee89646c2c1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.704194] env[69647]: INFO networking_nsxv3.common.synchronization [req-b3737d4c-8c9d-4508-9a66-99b19c0bce51 req-ba1e64de-c6c5-4cff-ace5-bbf3abe40b2c tempest-MultipleCreateTestJSON-207473124 tempest-MultipleCreateTestJSON-207473124-project-member] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 975.704838] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 975.705281] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.705507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.705649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.705904] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.706148] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.706364] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.706508] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.706808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.706970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.707720] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.737793] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c88cda88-ec94-40f5-96c9-0a718c5bbf44: rpc.has_security_group_logging(os_id): False [ 975.756803] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.756954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.757038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.757253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.757343] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.757574] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.757668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.758235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.758235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.758235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.758235] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.758235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.758506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.758506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.758506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.758629] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.758707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.758747] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.758880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.758944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.759048] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be updated. [ 975.812322] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.812603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.812738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.813083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.813346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.826504] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 975.876364] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0fbffbeb-5173-4e7a-966f-dee89646c2c1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.895792] env[69647]: INFO networking_nsxv3.common.synchronization [req-922163a4-ec2c-4a85-b0d3-40bce0d342a0 req-67494ca5-0ed2-483e-b83e-bc0728b75780 tempest-MultipleCreateTestJSON-207473124 tempest-MultipleCreateTestJSON-207473124-project-member] Enqueued Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 975.896291] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 with Priority: HIGHEST for action security_group_members [ 975.896588] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-c88cda88-ec94-40f5-96c9-0a718c5bbf44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.896687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.018051] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6168f488-7a73-4458-9cef-b4375e37e273 in Status: SUCCESS [ 976.018181] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.210556] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.378503] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0fbffbeb-5173-4e7a-966f-dee89646c2c1: rpc.has_security_group_logging(os_id): False [ 976.399571] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.399703] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.399779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.400090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.400189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.400434] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.400536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.400603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.400757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.400833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.400923] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 is going to be created. [ 976.475520] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.475734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.475815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.476140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.476398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.486893] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 in Status: IN_PROGRESS for 2s [ 976.712924] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.824077] env[69647]: INFO networking_nsxv3.common.synchronization [req-607d097c-8caa-426c-ba1f-a450f2761453 req-72c2fa34-91a8-4d06-ad74-b14f205f2bd8 tempest-ListServersNegativeTestJSON-225317695 tempest-ListServersNegativeTestJSON-225317695-project-member] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 976.824675] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 976.825026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.825186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.825258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.825538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.825720] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.825835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.825930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.826159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.826289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.826422] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.860764] env[69647]: INFO networking_nsxv3.common.synchronization [req-295c86a5-2b15-4748-a8bf-f04b9674d1b3 req-d0d291d0-2f63-4ec4-8f28-b904f241da6a tempest-ListServersNegativeTestJSON-225317695 tempest-ListServersNegativeTestJSON-225317695-project-member] Enqueued Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 976.861659] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc with Priority: HIGHEST for action security_group_members [ 976.862207] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd722ad1-4b5d-44e6-b813-2502626f7fdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.862353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.215539] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.215705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.215788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.216015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.216114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.216217] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be updated. [ 977.248957] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.249183] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.249256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.249463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.249607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.258094] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: IN_PROGRESS for 2s [ 977.300470] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 977.300632] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.329227] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.329379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.329450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.329657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.329750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.330064] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.330116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.330188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.330673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.330673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.330673] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc is going to be updated. [ 977.356134] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.356333] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.356390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.356574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.356716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.364708] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: IN_PROGRESS for 2s [ 977.850563] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 977.850824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.850998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.851241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.851365] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.392302] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.392302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.392302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.392302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.392302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.392302] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be deleted. [ 978.425076] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.425076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.425076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.425076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.425311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.425311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.500675] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 in Status: SUCCESS [ 978.500675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.269230] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 in Status: SUCCESS [ 979.269589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.269589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.269967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.270176] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.270302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.270370] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.270532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.270679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.270788] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c88cda88-ec94-40f5-96c9-0a718c5bbf44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.373871] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: SUCCESS [ 979.374121] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc deletion is rescheduled due to dependency. [ 979.374197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.374343] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.374552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.375977] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.375977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.375977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.375977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.375977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.375977] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd722ad1-4b5d-44e6-b813-2502626f7fdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.775239] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.775239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.775239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.775239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.775239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.775239] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.775239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.775771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.775771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.775771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.775771] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c88cda88-ec94-40f5-96c9-0a718c5bbf44 is going to be deleted. [ 979.806159] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.807081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.807081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.807081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.807081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.807081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c88cda88-ec94-40f5-96c9-0a718c5bbf44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.877646] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.877797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.877868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.878103] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.878188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.878374] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.878468] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.878528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.878675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.878745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.878828] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc is going to be updated. [ 979.915116] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.915286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.915351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.915598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.915698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.928398] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: IN_PROGRESS for 2s [ 981.863095] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 981.863640] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 981.940732] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc in Status: SUCCESS [ 981.940927] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd722ad1-4b5d-44e6-b813-2502626f7fdc deletion is rescheduled due to dependency. [ 981.941076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd722ad1-4b5d-44e6-b813-2502626f7fdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.672673] env[69647]: INFO networking_nsxv3.common.synchronization [req-e3ad4244-3e89-4c11-9e4c-2732723d70da req-a60a4b58-7c1c-4258-a876-f5b99866703d tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 983.673577] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 983.673577] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.673577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.673577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.673772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.674025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.674025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.674143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.674278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.674363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.674455] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.931530] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.931786] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.931931] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.932381] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.932809] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.933040] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.933174] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.933407] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.933553] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.933767] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.933885] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.934019] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.934142] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.934258] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.934365] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.934531] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.953099] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.953262] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 983.953400] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.953561] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.953847] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.954224] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.954224] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.954611] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.954611] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.176603] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.176769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.176843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.177076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.177173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.177364] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.177462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.177558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.177667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.177740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.177825] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be deleted. [ 984.203655] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.203808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.203853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.204057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.204151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.204247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.457778] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.458113] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.458307] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.458705] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.458908] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.459158] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b not found, creating... [ 984.459647] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.459838] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.460031] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.460376] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.460580] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.461018] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.461269] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.461464] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.461787] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.462022] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.462748] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b is going to be created. [ 984.482272] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.482699] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.482932] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.483367] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.483832] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.484404] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.319881] env[69647]: INFO networking_nsxv3.common.synchronization [req-e3ad4244-3e89-4c11-9e4c-2732723d70da req-88d3d061-3981-42cc-8521-b39ed329c08a service nova] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_rules [ 985.320182] env[69647]: INFO networking_nsxv3.common.synchronization [req-e3ad4244-3e89-4c11-9e4c-2732723d70da req-88d3d061-3981-42cc-8521-b39ed329c08a service nova] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 985.320273] env[69647]: INFO networking_nsxv3.common.synchronization [req-e3ad4244-3e89-4c11-9e4c-2732723d70da req-88d3d061-3981-42cc-8521-b39ed329c08a service nova] Enqueued Resource ID: 49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b with Priority: HIGHEST for action port [ 985.320533] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_rules [ 985.320630] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 985.320727] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b with Priority: HIGHEST for action port [ 985.321332] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.321468] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.321536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.321735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.321814] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.323685] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.323798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.323898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.324043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.324190] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.324991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.324991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.324991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.324991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.324991] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.325370] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.325493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.325523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.325671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.325741] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.827741] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.828692] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.828805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.830594] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b with status ACTIVE [ 985.830768] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.830888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.830950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.831198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.831291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.831461] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.831552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.831608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.831760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.831833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.832047] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.832167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.832246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.832397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.832472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.832553] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b is going to be updated. [ 985.854714] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.854835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.854910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.855139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.855278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.855432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49b03ab0-d3b7-4dc2-9b69-ea4ff268fa2b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.265718] env[69647]: INFO networking_nsxv3.common.synchronization [None req-273935f9-4ef4-4f6b-937f-6be30cb392e0 tempest-AttachVolumeTestJSON-1527312667 tempest-AttachVolumeTestJSON-1527312667-project-member] Enqueued Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_rules [ 986.266648] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_rules [ 986.267036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34219d1a-fbd9-401c-90a3-4321fbe00e34 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.267178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.267272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.267552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.267638] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.334333] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.360762] env[69647]: INFO networking_nsxv3.common.synchronization [None req-db96abca-d03e-48da-bf22-ed9afadd5fe8 tempest-AttachVolumeTestJSON-1527312667 tempest-AttachVolumeTestJSON-1527312667-project-member] Enqueued Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_rules [ 986.360762] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_rules [ 986.360762] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34219d1a-fbd9-401c-90a3-4321fbe00e34 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.360762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.787055] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.787211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.787283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.787497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.787587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.787682] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 already deleted. [ 986.787763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.787911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.788076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.788163] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.836325] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.836505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.836576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.836840] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.836947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.837738] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be created. [ 986.861707] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.861801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.861880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.862113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.862296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.876156] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: UNINITIALIZED for 2s [ 987.312260] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.312456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.312539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.312732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.312822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.312922] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 already deleted. [ 987.313059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.194692] env[69647]: INFO networking_nsxv3.common.synchronization [req-6e3eb7cc-a91e-4fb2-b6ae-6b5cdf7f2b6c req-c75181e1-df77-4b6c-9424-b4c3c5bc67e7 tempest-MigrationsAdminTest-1337534586 tempest-MigrationsAdminTest-1337534586-project-member] Enqueued Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 988.195249] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 988.195544] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.195671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.195728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.195907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.197589] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.197713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.197713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.197853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.197935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.198036] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.700036] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.886279] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 988.886668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.886935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.887293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.887603] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.887777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.887876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.888220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.888323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.888418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.888516] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.202328] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.391227] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.391375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.391443] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.391671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.391835] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.391945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.392536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.392536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.392536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.392536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.392536] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.392755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.392755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.392813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.392908] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.392998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.393134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.393260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.393339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.393439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.393527] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.704910] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.705158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.705158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.705344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.705437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.705549] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 is going to be updated. [ 989.738579] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.738745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.738804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.739014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.739162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.747998] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: IN_PROGRESS for 2s [ 989.895413] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9da9f265-ecd5-4341-a63a-3d1380826075: rpc.has_security_group_logging(os_id): False [ 989.911759] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.911906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.912037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.912265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.912358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.912565] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.912666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.912729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.912880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.913018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.913226] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.913323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.913385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.913530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.913603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.913779] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.913869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.913929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.914076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.914151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.914234] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be created. [ 989.975820] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.976058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.976058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.976271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.976452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.988819] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 990.759694] env[69647]: INFO networking_nsxv3.common.synchronization [None req-882ced2e-d233-462b-bf54-048342519eaf tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 990.761048] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 990.761048] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.761048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.761048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.761048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.761293] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.761339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.761373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.761725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.761725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.761841] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.265781] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.758013] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: SUCCESS [ 991.758249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.769423] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.953313] env[69647]: INFO networking_nsxv3.common.synchronization [req-325f6ce6-20b8-44ad-b44e-59c40bd2a09c req-fe85b8c8-0e51-40da-947d-ab13186f0a38 tempest-ImagesTestJSON-954996409 tempest-ImagesTestJSON-954996409-project-member] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 991.953874] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 991.954188] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.954315] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.955281] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.955493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.955652] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.955755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.955817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.955960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.956055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.956153] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.001313] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 992.001538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.272086] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.272086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.272086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.272086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.272086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.272086] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be updated. [ 992.300325] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.300528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.300609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.300820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.301032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.310333] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 992.453906] env[69647]: INFO networking_nsxv3.common.synchronization [req-40217ff3-e894-48ad-af01-d46ba4ede3c4 req-0b6e31ed-61b6-424e-af37-a03a235a3625 tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_members [ 992.454496] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGHEST for action security_group_members [ 992.454816] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.454937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.455023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.455633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.455847] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.456014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.456224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.456346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.456446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.456573] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.458039] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.458039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.458039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.458268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.458393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.458604] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.458749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.458847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.459039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.459166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.459350] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 992.486447] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.486584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.486656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.486850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.486987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.494577] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 992.958397] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.958701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.958701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.959134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.959287] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.959534] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.959684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.959781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.959955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.960041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.960129] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda is going to be updated. [ 992.985699] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.985837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.985907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.986203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.986379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.996322] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda in Status: IN_PROGRESS for 2s [ 993.251521] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.251521] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.251521] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.251778] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.252114] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.252310] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.252434] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.252694] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.252827] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.253829] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.253829] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.253829] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.253829] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.253829] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.253829] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.253829] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.273285] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.273391] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.273673] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.273673] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.273963] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-5d3f28c6-53e8-420f-a9da-78cb82da8c19 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.274419] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-5d3f28c6-53e8-420f-a9da-78cb82da8c19" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.274419] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-5d3f28c6-53e8-420f-a9da-78cb82da8c19" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.274584] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-5d3f28c6-53e8-420f-a9da-78cb82da8c19" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.274778] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d3f28c6-53e8-420f-a9da-78cb82da8c19',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.777488] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.778648] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.778648] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.778648] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.778648] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.779320] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 5d3f28c6-53e8-420f-a9da-78cb82da8c19 not found, creating... [ 993.779320] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.779454] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.779610] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.779955] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.780790] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.780935] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.781169] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.781374] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.782071] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.782071] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.782071] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 5d3f28c6-53e8-420f-a9da-78cb82da8c19 is going to be created. [ 993.799906] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.800211] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.800397] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.800728] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.801063] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.801373] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-5d3f28c6-53e8-420f-a9da-78cb82da8c19" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.142627] env[69647]: INFO networking_nsxv3.common.synchronization [req-19d5ff3b-f865-4c53-a1ae-12f13f9cc7f2 req-d9992249-0834-42a6-887a-171f924bfe08 tempest-ServersV294TestFqdnHostnames-399989070 tempest-ServersV294TestFqdnHostnames-399989070-project-member] Enqueued Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_members [ 994.143164] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_members [ 994.143544] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6ff3703-4f0f-4e11-8846-e36203877107 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.143837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.143911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.148462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.148652] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.148764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.148832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.149009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.149122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.149222] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.322155] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 994.322381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.504233] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 994.504378] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 deletion is rescheduled due to dependency. [ 994.504511] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.579273] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-639 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.579437] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-639" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.579498] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-639" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.579793] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-639" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.580080] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.580263] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.580394] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.580611] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.580736] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.580942] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.581068] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.581173] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.581574] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.581574] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.581574] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.581731] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.607906] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.607906] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.607906] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.607906] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-639" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.607906] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-357ca37a-197a-4190-b363-a32d403ecb09 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.607906] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-357ca37a-197a-4190-b363-a32d403ecb09" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.607906] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-357ca37a-197a-4190-b363-a32d403ecb09" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.607906] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-357ca37a-197a-4190-b363-a32d403ecb09" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.607906] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('357ca37a-197a-4190-b363-a32d403ecb09',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.627850] env[69647]: INFO networking_nsxv3.common.synchronization [req-ea1e5324-6e21-4694-b66a-2198714bc75b req-75d71a7f-87ed-4788-a024-b6409324f4be service nova] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_rules [ 994.628396] env[69647]: INFO networking_nsxv3.common.synchronization [req-ea1e5324-6e21-4694-b66a-2198714bc75b req-75d71a7f-87ed-4788-a024-b6409324f4be service nova] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 994.628464] env[69647]: INFO networking_nsxv3.common.synchronization [req-ea1e5324-6e21-4694-b66a-2198714bc75b req-75d71a7f-87ed-4788-a024-b6409324f4be service nova] Enqueued Resource ID: 5d3f28c6-53e8-420f-a9da-78cb82da8c19 with Priority: HIGHEST for action port [ 994.629651] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_rules [ 994.629651] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 994.631063] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d3f28c6-53e8-420f-a9da-78cb82da8c19 with Priority: HIGHEST for action port [ 994.631063] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.631063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.631063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.631063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.631063] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.631640] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.631857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.631936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.632173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.632319] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.632413] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.632475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.632613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.632700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.632788] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.633896] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d3f28c6-53e8-420f-a9da-78cb82da8c19 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.634014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d3f28c6-53e8-420f-a9da-78cb82da8c19" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.634085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d3f28c6-53e8-420f-a9da-78cb82da8c19" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.634234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d3f28c6-53e8-420f-a9da-78cb82da8c19" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.634310] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d3f28c6-53e8-420f-a9da-78cb82da8c19',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.651128] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.651128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.651222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.651356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.651443] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.651629] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.651723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.651785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.651928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.652054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.652145] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6ff3703-4f0f-4e11-8846-e36203877107 already deleted. [ 994.652224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.005109] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda in Status: SUCCESS [ 995.005325] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda deletion is rescheduled due to dependency. [ 995.005438] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.109784] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.110060] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.110214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.110473] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.110624] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.110781] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 357ca37a-197a-4190-b363-a32d403ecb09 not found, creating... [ 995.111054] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.111223] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.111342] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.111610] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.111740] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.112048] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.112221] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.112340] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.112546] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.112685] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.112823] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 357ca37a-197a-4190-b363-a32d403ecb09 is going to be created. [ 995.130524] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.130715] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.130838] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.131091] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.131317] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.131536] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-357ca37a-197a-4190-b363-a32d403ecb09" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.132524] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.132673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.134507] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.135781] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d3f28c6-53e8-420f-a9da-78cb82da8c19 with status ACTIVE [ 995.135954] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.136099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.136169] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.136340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.136421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.136587] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.136682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.136743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.136885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.136960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.137153] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.137233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.137297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.137433] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.137514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.137599] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d3f28c6-53e8-420f-a9da-78cb82da8c19 is going to be updated. [ 995.156637] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.156874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.156874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.157030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.157167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.157356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d3f28c6-53e8-420f-a9da-78cb82da8c19" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.636382] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.958065] env[69647]: INFO networking_nsxv3.common.synchronization [req-19d5ff3b-f865-4c53-a1ae-12f13f9cc7f2 req-77c0b201-efa9-49ca-b955-c101d7e80452 service nova] Enqueued Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_rules [ 995.958338] env[69647]: INFO networking_nsxv3.common.synchronization [req-19d5ff3b-f865-4c53-a1ae-12f13f9cc7f2 req-77c0b201-efa9-49ca-b955-c101d7e80452 service nova] Enqueued Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_members [ 995.958391] env[69647]: INFO networking_nsxv3.common.synchronization [req-19d5ff3b-f865-4c53-a1ae-12f13f9cc7f2 req-77c0b201-efa9-49ca-b955-c101d7e80452 service nova] Enqueued Resource ID: 357ca37a-197a-4190-b363-a32d403ecb09 with Priority: HIGHEST for action port [ 995.958923] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_rules [ 995.959057] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_members [ 995.959160] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 357ca37a-197a-4190-b363-a32d403ecb09 with Priority: HIGHEST for action port [ 995.959459] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6ff3703-4f0f-4e11-8846-e36203877107 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.959556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.959622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.959817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.959897] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.960915] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6ff3703-4f0f-4e11-8846-e36203877107 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.961042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.961121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.961268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.961407] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.961500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.961555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.961690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.961785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.961854] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.962595] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-357ca37a-197a-4190-b363-a32d403ecb09 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.962702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-357ca37a-197a-4190-b363-a32d403ecb09" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.962768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-357ca37a-197a-4190-b363-a32d403ecb09" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.962914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-357ca37a-197a-4190-b363-a32d403ecb09" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.962990] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('357ca37a-197a-4190-b363-a32d403ecb09',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.142497] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.142497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.142497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.142497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.142497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.142497] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be updated. [ 996.172411] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.172411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.172411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.172411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.172411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.179269] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 996.466114] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 357ca37a-197a-4190-b363-a32d403ecb09 with status ACTIVE [ 996.466375] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.466513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.466583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.466802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.466892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.467087] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.467191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.467245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.467386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.467463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.467642] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.467733] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.467791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.467925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.467997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.468094] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 357ca37a-197a-4190-b363-a32d403ecb09 is going to be updated. [ 996.469210] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6ff3703-4f0f-4e11-8846-e36203877107 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.469312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.469472] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.491591] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.491764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.491862] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.492162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.492343] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.492530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-357ca37a-197a-4190-b363-a32d403ecb09" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.971879] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.474652] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.474997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.474997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.475362] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.475461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.475570] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6ff3703-4f0f-4e11-8846-e36203877107 is going to be created. [ 997.498563] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.498724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.498795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.499021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.499186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.510022] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6ff3703-4f0f-4e11-8846-e36203877107 in Status: UNINITIALIZED for 2s [ 998.194369] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 998.194369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.194369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.194369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.194579] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.194579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.194655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.194742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.194821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.194906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.194997] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.697462] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.697799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.697799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.697903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.698097] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.698199] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.698260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.698415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.698500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.698588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.698733] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.698824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.698885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.699034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.699171] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.699261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.699319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.699454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.699527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.699607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.699695] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.790822] env[69647]: INFO networking_nsxv3.common.synchronization [req-d3d1e02c-3c20-44b3-85c8-395504320724 req-9918914b-5a18-406f-b67b-94f9bb9d9b2a tempest-ServersAdminTestJSON-1923625429 tempest-ServersAdminTestJSON-1923625429-project-member] Enqueued Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 998.791390] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b912c1-294b-407e-bd8a-c81f04912b02 with Priority: HIGHEST for action security_group_members [ 998.791727] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-27b912c1-294b-407e-bd8a-c81f04912b02 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.791822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.791901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.792152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.792308] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.792407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.792468] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.792818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.792818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.792818] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27b912c1-294b-407e-bd8a-c81f04912b02',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.202367] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9da9f265-ecd5-4341-a63a-3d1380826075: rpc.has_security_group_logging(os_id): False [ 999.221411] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.221855] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.221959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.222538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.222731] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.222996] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.223403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.223403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.223403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.223557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.223734] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.223864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.224057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.224143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.224246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.224459] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.224584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.224671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.224840] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.224947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.225074] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be updated. [ 999.281570] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.281810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.281901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.282309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.282545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.297899] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 999.300830] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.300830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.300830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.300830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.300830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.300830] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.300830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.300830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.300830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.300830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.300830] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 is going to be updated. [ 999.328145] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.328322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.328380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.328602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.328767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.336849] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: IN_PROGRESS for 2s [ 999.518232] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6ff3703-4f0f-4e11-8846-e36203877107 in Status: SUCCESS [ 999.518419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.520036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.520036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.520036] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.520036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.520036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.520036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.520036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.520036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.520036] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.021301] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.526526] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6ff3703-4f0f-4e11-8846-e36203877107: rpc.has_security_group_logging(os_id): False [ 1000.544429] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.544825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.544994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.545798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.546056] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.546407] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.546624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.546876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.548020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.548020] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.548020] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6ff3703-4f0f-4e11-8846-e36203877107 is going to be created. [ 1000.605448] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.605448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.605448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.605448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.605448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.617216] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6ff3703-4f0f-4e11-8846-e36203877107 in Status: IN_PROGRESS for 2s [ 1001.311897] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 1001.312252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.346648] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27b912c1-294b-407e-bd8a-c81f04912b02 in Status: SUCCESS [ 1001.346784] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27b912c1-294b-407e-bd8a-c81f04912b02 deletion is rescheduled due to dependency. [ 1001.346909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27b912c1-294b-407e-bd8a-c81f04912b02" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.056891] env[69647]: INFO networking_nsxv3.common.synchronization [req-220fd26c-51fd-4ee8-8ae0-038eeef8b8d4 req-63b25505-6c06-4ec2-ace6-53cf209cd8c5 tempest-AttachVolumeShelveTestJSON-989009573 tempest-AttachVolumeShelveTestJSON-989009573-project-member] Enqueued Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_members [ 1002.057466] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 with Priority: HIGHEST for action security_group_members [ 1002.057770] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-63aea974-cdb8-4b5a-9001-4a1c99d2d349 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.058176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.058176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.058335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.058524] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.058667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.058763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.058957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.059100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.059257] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63aea974-cdb8-4b5a-9001-4a1c99d2d349',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.564327] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.564327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.564327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.564327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.564327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.564327] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.564327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.564327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.564327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.564327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.564327] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 is going to be updated. [ 1002.589497] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.589497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.589497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.589497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.591143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.596992] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 in Status: IN_PROGRESS for 2s [ 1002.627090] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6ff3703-4f0f-4e11-8846-e36203877107 in Status: SUCCESS [ 1002.627308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.561028] env[69647]: INFO networking_nsxv3.common.synchronization [None req-83d68d88-a96f-420c-bc6b-3cceb6612269 None None] Enqueued Resource ID: 6760def4-e6c9-4a05-bd36-8382e0573b56 with Priority: HIGHEST for action port [ 1003.561435] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6760def4-e6c9-4a05-bd36-8382e0573b56 with Priority: HIGHEST for action port [ 1003.561734] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-6760def4-e6c9-4a05-bd36-8382e0573b56 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.561855] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6760def4-e6c9-4a05-bd36-8382e0573b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.561921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6760def4-e6c9-4a05-bd36-8382e0573b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.562430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6760def4-e6c9-4a05-bd36-8382e0573b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.562563] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6760def4-e6c9-4a05-bd36-8382e0573b56',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.064730] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6760def4-e6c9-4a05-bd36-8382e0573b56 [ 1004.069019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.069019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.069019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.069019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.069019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.069019] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6760def4-e6c9-4a05-bd36-8382e0573b56 already deleted. [ 1004.069019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6760def4-e6c9-4a05-bd36-8382e0573b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.609215] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 in Status: SUCCESS [ 1004.609215] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63aea974-cdb8-4b5a-9001-4a1c99d2d349 deletion is rescheduled due to dependency. [ 1004.609215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63aea974-cdb8-4b5a-9001-4a1c99d2d349" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.849781] env[69647]: INFO networking_nsxv3.common.synchronization [None req-126a9c84-e36c-4098-b816-d2e81b0b0783 None None] Enqueued Resource ID: 7189061f-cba1-4854-88d4-9130b1a904cf with Priority: HIGHEST for action port [ 1005.850390] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7189061f-cba1-4854-88d4-9130b1a904cf with Priority: HIGHEST for action port [ 1005.851073] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-7189061f-cba1-4854-88d4-9130b1a904cf taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.851255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7189061f-cba1-4854-88d4-9130b1a904cf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.851375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7189061f-cba1-4854-88d4-9130b1a904cf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.851781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7189061f-cba1-4854-88d4-9130b1a904cf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.851897] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7189061f-cba1-4854-88d4-9130b1a904cf',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.180183] env[69647]: INFO networking_nsxv3.common.synchronization [req-f1d29131-5f4e-47e8-b39c-5030235782b4 req-e9337242-47c3-4ef8-b00d-7654a82c6c17 tempest-ServerActionsTestOtherB-626642147 tempest-ServerActionsTestOtherB-626642147-project-member] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1006.180730] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1006.181083] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.181810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.181810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.182153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.182325] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.182461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.182530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.182711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.182795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.182900] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.355031] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7189061f-cba1-4854-88d4-9130b1a904cf [ 1006.355031] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.355031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.355031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.355031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.355031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.355031] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7189061f-cba1-4854-88d4-9130b1a904cf already deleted. [ 1006.355031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7189061f-cba1-4854-88d4-9130b1a904cf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.491770] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.491985] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.492181] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.492465] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.492734] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.492896] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.493029] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.493280] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.493432] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.493650] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.493765] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.493886] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.493996] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.494122] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.494233] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.494369] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.511693] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.511857] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1006.511995] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.512200] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.512487] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-5ae7df77-d974-48db-b833-8e62eef3b03f taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.512655] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-5ae7df77-d974-48db-b833-8e62eef3b03f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.512774] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-5ae7df77-d974-48db-b833-8e62eef3b03f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.513123] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-5ae7df77-d974-48db-b833-8e62eef3b03f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.513286] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ae7df77-d974-48db-b833-8e62eef3b03f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.685076] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.685423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.685423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.685569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.685985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.685985] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.685985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.685985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.686231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.686231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.686972] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be updated. [ 1006.710373] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.710521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.710588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.711066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.711241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.719104] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 1006.812728] env[69647]: INFO networking_nsxv3.common.synchronization [req-d515d8a8-6c2f-46eb-8b13-693169bdae58 req-d06d381b-1ac1-4cfc-86f8-f55228afd189 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1006.813342] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1006.813635] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.813756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.813817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.814021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.814173] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.814266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.814328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.814494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.814578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.814670] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.016757] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.017088] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.017486] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.017558] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.018972] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.019240] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 5ae7df77-d974-48db-b833-8e62eef3b03f not found, creating... [ 1007.019571] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.019787] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.020015] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.020248] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.020425] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.020753] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.020979] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.021131] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.021523] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.021755] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.021924] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 5ae7df77-d974-48db-b833-8e62eef3b03f is going to be created. [ 1007.043111] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.043562] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.043803] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.044177] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.045352] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.045352] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-5ae7df77-d974-48db-b833-8e62eef3b03f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.318896] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.599100] env[69647]: INFO networking_nsxv3.common.synchronization [None req-6db918cd-f7cd-4f26-9524-0f3f7ae267a3 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1007.599100] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1007.599100] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.599100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.818975] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.979088] env[69647]: INFO networking_nsxv3.common.synchronization [req-f1d29131-5f4e-47e8-b39c-5030235782b4 req-54f28ea9-0626-410a-8570-326ecc40ccd0 service nova] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 1007.979282] env[69647]: INFO networking_nsxv3.common.synchronization [req-f1d29131-5f4e-47e8-b39c-5030235782b4 req-54f28ea9-0626-410a-8570-326ecc40ccd0 service nova] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1007.979425] env[69647]: INFO networking_nsxv3.common.synchronization [req-f1d29131-5f4e-47e8-b39c-5030235782b4 req-54f28ea9-0626-410a-8570-326ecc40ccd0 service nova] Enqueued Resource ID: 5ae7df77-d974-48db-b833-8e62eef3b03f with Priority: HIGHEST for action port [ 1007.979670] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 1007.979806] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1007.979989] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ae7df77-d974-48db-b833-8e62eef3b03f with Priority: HIGHEST for action port [ 1007.980698] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.981316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.981316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.981316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.981316] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.982205] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.982325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.982528] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ae7df77-d974-48db-b833-8e62eef3b03f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.982613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ae7df77-d974-48db-b833-8e62eef3b03f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.982659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ae7df77-d974-48db-b833-8e62eef3b03f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.982826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ae7df77-d974-48db-b833-8e62eef3b03f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.982888] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ae7df77-d974-48db-b833-8e62eef3b03f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.321816] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.322365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.322365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.322365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.322465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.322522] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be updated. [ 1008.352733] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.352949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.352949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.353286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.353456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.361776] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 1008.490046] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ae7df77-d974-48db-b833-8e62eef3b03f with status ACTIVE [ 1008.490299] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.490432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.490501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.490716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.490802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.490981] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.491093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.491151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.491297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.491372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.491549] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.491642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.491710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.491850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.491923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.492020] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ae7df77-d974-48db-b833-8e62eef3b03f is going to be updated. [ 1008.494101] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.494219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.515069] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.515220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.515304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.515658] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.515658] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.515795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ae7df77-d974-48db-b833-8e62eef3b03f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.598278] env[69647]: INFO networking_nsxv3.common.synchronization [None req-82eb2a53-829f-4753-a522-71c38e31f6fd None None] Enqueued Resource ID: 3e606467-fe01-43d9-a099-919167c6a359 with Priority: HIGHEST for action port [ 1008.598792] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e606467-fe01-43d9-a099-919167c6a359 with Priority: HIGHEST for action port [ 1008.599110] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e606467-fe01-43d9-a099-919167c6a359 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.599237] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e606467-fe01-43d9-a099-919167c6a359" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.599305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e606467-fe01-43d9-a099-919167c6a359" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.599550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e606467-fe01-43d9-a099-919167c6a359" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.599644] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e606467-fe01-43d9-a099-919167c6a359',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.728398] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 1008.728569] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 deletion is rescheduled due to dependency. [ 1008.728681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.729185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.729402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.729578] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.729697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.729763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.729913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.729996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.730104] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.103017] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e606467-fe01-43d9-a099-919167c6a359 [ 1009.103017] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.103017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.103017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.103257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.103257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.103316] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e606467-fe01-43d9-a099-919167c6a359 already deleted. [ 1009.103413] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e606467-fe01-43d9-a099-919167c6a359" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.232510] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.736474] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.937311] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-878 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.937533] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.937657] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.937958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.938466] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.938696] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.938821] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.939077] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.939222] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.939444] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.939560] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.939671] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.939779] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.939890] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.940070] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.940233] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.957336] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.957508] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1009.957651] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.957829] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-878" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.958231] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1e6a7509-0b62-47da-8ef9-6848daff80b6 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.958427] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.958589] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.958806] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.958964] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e6a7509-0b62-47da-8ef9-6848daff80b6',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.239301] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.239824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.239911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.240150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.240247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.240351] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be updated. [ 1010.266083] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.266230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.266300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.266531] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.266738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.274331] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 1010.371279] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 1010.371649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.371918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.372349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.372620] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.372779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.372867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.373447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.373639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.373855] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.464892] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.465021] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.465101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.467551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.467551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.467551] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.467551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.467551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.467551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.467551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.467551] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.467551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.467551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.470427] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.470480] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.470689] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1e6a7509-0b62-47da-8ef9-6848daff80b6 is going to be updated. [ 1010.483816] env[69647]: INFO networking_nsxv3.common.synchronization [req-dc58a16b-8fb4-486f-bfd6-8db4bdea458d req-775cc732-9f8c-459e-9ffa-2f35a6c03991 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_members [ 1010.483816] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGHEST for action security_group_members [ 1010.484420] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.484420] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.484420] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.484595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.485128] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.485128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.485128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.485128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.485327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.485327] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bd6af1f-0d53-486d-ac51-c6ef7bb925cc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.491439] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.491662] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.491924] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.492156] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.492394] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.492646] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.876852] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.877153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.877153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.877549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.877690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.877951] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.878129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.878231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.878483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.878609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.878749] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be updated. [ 1010.899370] env[69647]: INFO networking_nsxv3.common.synchronization [None req-3277efea-3622-44c0-93a4-ef508c2d9fb4 None None] Enqueued Resource ID: 0c7b5f76-887f-4685-82eb-d2c6235d137e with Priority: HIGHEST for action port [ 1010.900863] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c7b5f76-887f-4685-82eb-d2c6235d137e with Priority: HIGHEST for action port [ 1010.900863] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c7b5f76-887f-4685-82eb-d2c6235d137e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.900863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c7b5f76-887f-4685-82eb-d2c6235d137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.901065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c7b5f76-887f-4685-82eb-d2c6235d137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.901345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c7b5f76-887f-4685-82eb-d2c6235d137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.901835] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c7b5f76-887f-4685-82eb-d2c6235d137e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.903604] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.903785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.904368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.904477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.904651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.914780] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 1010.987245] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.987409] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.987481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.987751] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.987897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.989026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.989026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.989026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.989026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.989026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.989026] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc is going to be updated. [ 1011.016340] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.016491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.016561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.016805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.016906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.024977] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc in Status: IN_PROGRESS for 2s [ 1011.208310] env[69647]: INFO networking_nsxv3.common.synchronization [req-4383bd4c-8e07-4f2d-99bf-8a4f167cfb86 req-4be89f4a-71b9-43f9-bd6e-10c4b50dbb9e service nova] Enqueued Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_rules [ 1011.208478] env[69647]: INFO networking_nsxv3.common.synchronization [req-4383bd4c-8e07-4f2d-99bf-8a4f167cfb86 req-4be89f4a-71b9-43f9-bd6e-10c4b50dbb9e service nova] Enqueued Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 1011.208624] env[69647]: INFO networking_nsxv3.common.synchronization [req-4383bd4c-8e07-4f2d-99bf-8a4f167cfb86 req-4be89f4a-71b9-43f9-bd6e-10c4b50dbb9e service nova] Enqueued Resource ID: 1e6a7509-0b62-47da-8ef9-6848daff80b6 with Priority: HIGHEST for action port [ 1011.208856] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_rules [ 1011.208986] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 1011.209091] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e6a7509-0b62-47da-8ef9-6848daff80b6 with Priority: HIGHEST for action port [ 1011.209839] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.209975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.210058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.210334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.210414] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.212224] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.212334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.212426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.212630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.212729] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.212910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.212910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.212992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.213248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.213248] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.213976] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e6a7509-0b62-47da-8ef9-6848daff80b6 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.218013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.218013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.218013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.218013] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e6a7509-0b62-47da-8ef9-6848daff80b6',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.407027] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c7b5f76-887f-4685-82eb-d2c6235d137e [ 1011.407339] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.407555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.407555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.407751] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.407845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.407942] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c7b5f76-887f-4685-82eb-d2c6235d137e already deleted. [ 1011.408035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c7b5f76-887f-4685-82eb-d2c6235d137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.719437] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.720567] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.720714] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.720879] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e6a7509-0b62-47da-8ef9-6848daff80b6 with status ACTIVE [ 1011.721253] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.721253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.721483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.721555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.721643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.721808] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.722176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.722176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.722331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.722451] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.722761] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.722963] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.722963] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.723116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.723211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.723350] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e6a7509-0b62-47da-8ef9-6848daff80b6 is going to be updated. [ 1011.883544] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.883884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.883884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.883972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.884185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.884358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e6a7509-0b62-47da-8ef9-6848daff80b6" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.225186] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.284104] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 1012.284413] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.284655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.284969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.285263] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.285439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.285544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.285784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.285911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.286061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.286208] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.727644] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.727869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.727955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.728753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.731174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.731317] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 is going to be updated. [ 1012.762817] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.762960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.763050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.763310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.763453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.772415] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: IN_PROGRESS for 2s [ 1012.788868] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.923709] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 1012.923999] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 deletion is rescheduled due to dependency. [ 1012.924076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.973404] env[69647]: INFO networking_nsxv3.common.synchronization [req-84614cde-98c7-4697-bf2a-4c8803a32f38 req-1ed283a1-10e8-4d9b-a8b1-7b6699ce6290 tempest-AttachVolumeTestJSON-1527312667 tempest-AttachVolumeTestJSON-1527312667-project-member] Enqueued Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_members [ 1012.973890] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_members [ 1012.974222] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-34219d1a-fbd9-401c-90a3-4321fbe00e34 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.975012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.975012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.975012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.975012] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.975012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.975012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.975295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.975295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.975360] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.033491] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc in Status: SUCCESS [ 1013.033674] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc deletion is rescheduled due to dependency. [ 1013.033790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.292797] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c35014e-8d95-4c20-872d-da537d220b20: rpc.has_security_group_logging(os_id): False [ 1013.308829] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.309014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.309145] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.309376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.309467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.309721] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.309823] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.309890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.310058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.310138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.310228] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be updated. [ 1013.371719] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.371979] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-245" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.372165] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-245" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.372526] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-245" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.372833] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.373062] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.373438] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.373707] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.373912] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.374155] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.374329] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.374487] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.374610] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.374726] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.375203] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.375203] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.377515] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.377664] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.377746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.377943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.378150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.390925] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 1013.396579] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.396813] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1013.397042] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.397236] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-245" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.397557] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-d2ef1521-59b1-4c78-ade7-775ebd4bae98 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.397973] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-d2ef1521-59b1-4c78-ade7-775ebd4bae98" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.397973] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-d2ef1521-59b1-4c78-ade7-775ebd4bae98" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.398220] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-d2ef1521-59b1-4c78-ade7-775ebd4bae98" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.398350] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2ef1521-59b1-4c78-ade7-775ebd4bae98',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.478475] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.478649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.478707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.478922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.479089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.479219] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.479319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.479378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.479528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.479602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.479691] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 already deleted. [ 1013.479765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.901101] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.901101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.901101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.901101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.901324] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.901438] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port d2ef1521-59b1-4c78-ade7-775ebd4bae98 not found, creating... [ 1013.901637] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.901814] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.901901] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.902179] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.902773] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.902773] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.902773] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.903078] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.903132] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.903235] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.903376] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: d2ef1521-59b1-4c78-ade7-775ebd4bae98 is going to be created. [ 1013.931378] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.931676] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.931826] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.932194] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.932448] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.932731] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-d2ef1521-59b1-4c78-ade7-775ebd4bae98" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.631398] env[69647]: INFO networking_nsxv3.common.synchronization [req-84614cde-98c7-4697-bf2a-4c8803a32f38 req-b8f2a2cf-8d8d-4638-ae12-29d2bfba9a62 service nova] Enqueued Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_rules [ 1014.631578] env[69647]: INFO networking_nsxv3.common.synchronization [req-84614cde-98c7-4697-bf2a-4c8803a32f38 req-b8f2a2cf-8d8d-4638-ae12-29d2bfba9a62 service nova] Enqueued Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_members [ 1014.631737] env[69647]: INFO networking_nsxv3.common.synchronization [req-84614cde-98c7-4697-bf2a-4c8803a32f38 req-b8f2a2cf-8d8d-4638-ae12-29d2bfba9a62 service nova] Enqueued Resource ID: d2ef1521-59b1-4c78-ade7-775ebd4bae98 with Priority: HIGHEST for action port [ 1014.632305] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_rules [ 1014.632437] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_members [ 1014.632531] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ef1521-59b1-4c78-ade7-775ebd4bae98 with Priority: HIGHEST for action port [ 1014.632802] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34219d1a-fbd9-401c-90a3-4321fbe00e34 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.632924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.632992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.635197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.635290] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.639448] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-34219d1a-fbd9-401c-90a3-4321fbe00e34 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.639708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.639708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.639787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.639979] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.640135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.640206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.640372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.640455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.640559] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.642362] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2ef1521-59b1-4c78-ade7-775ebd4bae98 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.642475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2ef1521-59b1-4c78-ade7-775ebd4bae98" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.642520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2ef1521-59b1-4c78-ade7-775ebd4bae98" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.645037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2ef1521-59b1-4c78-ade7-775ebd4bae98" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.645037] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2ef1521-59b1-4c78-ade7-775ebd4bae98',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.785904] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: SUCCESS [ 1014.786129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.786304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.786516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.786702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.786856] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.786911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.787075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.787123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.787818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.787818] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.139883] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-34219d1a-fbd9-401c-90a3-4321fbe00e34 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.140241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.146803] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2ef1521-59b1-4c78-ade7-775ebd4bae98 with status ACTIVE [ 1015.146904] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.147051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.147166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.147569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.147569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.147764] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.147848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.147910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.148096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.148204] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.148729] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.148729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.148729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.148729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.148912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.148912] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2ef1521-59b1-4c78-ade7-775ebd4bae98 is going to be updated. [ 1015.150122] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.168383] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.169120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.169120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.169120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.169120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.169120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2ef1521-59b1-4c78-ade7-775ebd4bae98" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.287125] env[69647]: INFO networking_nsxv3.common.synchronization [req-1888d932-d683-4ea2-8a59-6dd2d4706cfd req-9668e50b-56c9-4217-ad80-4d14e0504c0b tempest-ImagesTestJSON-954996409 tempest-ImagesTestJSON-954996409-project-member] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 1015.287714] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 1015.288150] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.288533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.288610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.288806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.288962] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.289106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.289186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.289349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.289431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.289527] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.290381] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.290506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.290573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.290735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.290878] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.290971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.291042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.291195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.291274] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.291355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.291496] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.291699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.291812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.291922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.295201] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.295310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.295361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.295510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.295587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.295669] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.295753] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.405245] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 1015.405472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.655100] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.719170] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-984 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.719170] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.719170] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.719170] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.719170] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.719170] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.720138] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.721173] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.721688] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.722201] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.722531] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.722801] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.723085] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.723938] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1015.725018] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.725018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.746033] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.746033] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1015.746033] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.746033] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-984" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.746033] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.746033] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.746033] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.746033] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.746033] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.758645] env[69647]: INFO networking_nsxv3.common.synchronization [req-5120bef1-5886-4c71-bc9f-234a5dc09bcf req-745e4e3f-9877-4a10-a5d9-a201712349d3 tempest-MigrationsAdminTest-1337534586 tempest-MigrationsAdminTest-1337534586-project-member] Enqueued Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 1015.759663] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGHEST for action security_group_members [ 1015.759663] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.759663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.759663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.759959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.760124] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.760274] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.760373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.760583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.760709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.760847] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.798009] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.798181] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.798271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.798515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.798722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.798843] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.798961] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.799073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.799252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.799358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.799452] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 1015.800562] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 690e1872-1ae4-4c49-8159-ec39c82e2868: rpc.has_security_group_logging(os_id): False [ 1015.824852] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.824983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.825069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.825275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.825364] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.825578] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.825683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.826193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.826193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.826193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.826193] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.826406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.826406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.826406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.826490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.826711] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.826806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.826864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.827015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.827105] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.827170] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 is going to be updated. [ 1015.832262] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.832382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.832448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.832588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.832927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.841258] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 1015.899480] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.899634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.899705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.899937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.900181] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.919580] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: IN_PROGRESS for 2s [ 1016.159375] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.159741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.159741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.159874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.159874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.159979] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 is going to be created. [ 1016.184841] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.184841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.184841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.184841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.184841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.192949] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 in Status: UNINITIALIZED for 2s [ 1016.252410] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.252410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.252410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.252410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.252410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.252410] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5 not found, creating... [ 1016.252410] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.252410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.252410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.252410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.252410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.252850] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.252850] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.253236] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.253603] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.253963] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.254253] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5 is going to be created. [ 1016.263505] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.263890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.266040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.266040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.266040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.266040] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.266040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.266040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.266040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.266040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.266040] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 is going to be updated. [ 1016.276046] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.277751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.277751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.277751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.277751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.277751] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.291206] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.291206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.291206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.291206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.291206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.298316] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: IN_PROGRESS for 2s [ 1017.141918] env[69647]: INFO networking_nsxv3.common.synchronization [req-1888d932-d683-4ea2-8a59-6dd2d4706cfd req-2c83305a-cecf-41ef-8a82-f045cadcac3b service nova] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_rules [ 1017.141918] env[69647]: INFO networking_nsxv3.common.synchronization [req-1888d932-d683-4ea2-8a59-6dd2d4706cfd req-2c83305a-cecf-41ef-8a82-f045cadcac3b service nova] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 1017.141918] env[69647]: INFO networking_nsxv3.common.synchronization [req-1888d932-d683-4ea2-8a59-6dd2d4706cfd req-2c83305a-cecf-41ef-8a82-f045cadcac3b service nova] Enqueued Resource ID: 5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5 with Priority: HIGHEST for action port [ 1017.144781] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_rules [ 1017.144781] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 1017.144781] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5 with Priority: HIGHEST for action port [ 1017.145797] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.145797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.145797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.145797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.145797] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.148080] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.148225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.148509] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.148635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.148741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.148949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.149054] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.650152] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.650152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.651109] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5 with status ACTIVE [ 1017.651180] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.651276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.651459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.651570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.651657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.651834] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.651921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.651980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.652260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.652363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.652576] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.652665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.652806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.652883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.652959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.653172] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5 is going to be updated. [ 1017.684214] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.684417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.684562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.684899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.685177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.685486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a4064d1-8021-4ec6-bd4f-ad0c5cda16b5" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.856361] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 1017.856361] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 deletion is rescheduled due to dependency. [ 1017.856361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.856361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.856361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.856361] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.856361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.856361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.856361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.856361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.856361] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.937140] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: SUCCESS [ 1017.937440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.205417] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 in Status: SUCCESS [ 1018.205735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.205971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.206325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.206601] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.206771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.206874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.207118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.207235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.207368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.207505] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.307917] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 in Status: SUCCESS [ 1018.308171] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 deletion is rescheduled due to dependency. [ 1018.308325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.359658] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.711033] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.862448] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.213226] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34219d1a-fbd9-401c-90a3-4321fbe00e34: rpc.has_security_group_logging(os_id): False [ 1019.231591] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.231781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.231842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.232146] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.232283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.232549] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.232659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.232722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.232914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.233159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.233247] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 is going to be created. [ 1019.289971] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.290278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.290404] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.290651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.290848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.303594] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 in Status: IN_PROGRESS for 2s [ 1019.365334] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.365521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.365569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.365801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.365910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.366045] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 1019.396716] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.396911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.397032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.397189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.397325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.419778] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 1019.824867] env[69647]: INFO networking_nsxv3.common.synchronization [req-a1c9fc77-2b57-4c7f-bdb2-e56ebff64d6a req-574ae248-41f4-4062-a16a-a351f6ab5967 tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1019.825494] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1019.825812] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.825969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.826334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.826602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.826836] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.826997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.827125] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.827269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.827380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.827514] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.171731] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.172434] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.172434] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.172826] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.173289] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.173536] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.173712] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.174067] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.174257] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.174554] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.174681] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.174793] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.175896] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.175896] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.175896] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.175896] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.197704] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.197898] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1020.198031] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.198265] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.198647] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-9bdf4865-8345-4b82-90d0-927ef3d3cd2e taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.198840] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-9bdf4865-8345-4b82-90d0-927ef3d3cd2e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.199016] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-9bdf4865-8345-4b82-90d0-927ef3d3cd2e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.199425] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-9bdf4865-8345-4b82-90d0-927ef3d3cd2e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.199571] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bdf4865-8345-4b82-90d0-927ef3d3cd2e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.330747] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.330970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.330970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.331201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.331295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.331499] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.331597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.331647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.331802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.331878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.331962] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 1020.359242] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.359473] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.359473] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.360095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.360321] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.371773] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 1020.457336] env[69647]: INFO networking_nsxv3.common.synchronization [req-76c5d798-e95c-41c1-944f-ff497c65b1bf req-428faeb7-826e-4094-8355-d947a60f0fff tempest-ServersTestBootFromVolume-391508555 tempest-ServersTestBootFromVolume-391508555-project-member] Enqueued Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_members [ 1020.457497] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGHEST for action security_group_members [ 1020.457754] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fbffbeb-5173-4e7a-966f-dee89646c2c1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.457878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.457945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.458176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.458338] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.458440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.458502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.458652] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.458738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.458833] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fbffbeb-5173-4e7a-966f-dee89646c2c1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.702279] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.703069] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.703069] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.703069] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.703338] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.703338] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 9bdf4865-8345-4b82-90d0-927ef3d3cd2e not found, creating... [ 1020.703539] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.704507] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.704507] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.704507] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.704507] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.704507] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.704817] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.704817] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.705818] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.705818] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.705818] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 9bdf4865-8345-4b82-90d0-927ef3d3cd2e is going to be created. [ 1020.726531] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.726798] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.726928] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.727250] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.727487] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.727722] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-9bdf4865-8345-4b82-90d0-927ef3d3cd2e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.960883] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.961217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.961217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.961433] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.961550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.961815] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.961907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.961973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.962205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.962282] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.962383] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 is going to be updated. [ 1020.995099] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.995253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.995314] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.995509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.995649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.004260] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 in Status: IN_PROGRESS for 2s [ 1021.318326] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 in Status: SUCCESS [ 1021.318908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.432622] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 1021.432860] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.432980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.433300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.433548] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.433634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.433680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.433824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.433899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.433978] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.434087] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.444725] env[69647]: INFO networking_nsxv3.common.synchronization [req-a1c9fc77-2b57-4c7f-bdb2-e56ebff64d6a req-0b7cae74-339a-4967-b6b5-faeaea52ca2f service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 1021.444961] env[69647]: INFO networking_nsxv3.common.synchronization [req-a1c9fc77-2b57-4c7f-bdb2-e56ebff64d6a req-0b7cae74-339a-4967-b6b5-faeaea52ca2f service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1021.445051] env[69647]: INFO networking_nsxv3.common.synchronization [req-a1c9fc77-2b57-4c7f-bdb2-e56ebff64d6a req-0b7cae74-339a-4967-b6b5-faeaea52ca2f service nova] Enqueued Resource ID: 9bdf4865-8345-4b82-90d0-927ef3d3cd2e with Priority: HIGHEST for action port [ 1021.445928] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 1021.445988] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1021.446054] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bdf4865-8345-4b82-90d0-927ef3d3cd2e with Priority: HIGHEST for action port [ 1021.446556] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.446674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.446740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.446920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.446993] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.448849] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.448983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.449150] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bdf4865-8345-4b82-90d0-927ef3d3cd2e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.449432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bdf4865-8345-4b82-90d0-927ef3d3cd2e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.449432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bdf4865-8345-4b82-90d0-927ef3d3cd2e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.449545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bdf4865-8345-4b82-90d0-927ef3d3cd2e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.449545] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bdf4865-8345-4b82-90d0-927ef3d3cd2e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.936735] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.936978] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.937126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.937407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.937660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.937795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.937854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.938092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.938222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.938366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.938575] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.938683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.938768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.938922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.939083] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.939178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.939242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.939383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.939470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.939577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.939689] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.951764] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.951764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.951960] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bdf4865-8345-4b82-90d0-927ef3d3cd2e with status ACTIVE [ 1021.952170] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.952170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.952269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.952447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.952529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.952701] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.952793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.952856] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.953016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.953092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.953276] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.953357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.953440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.953582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.953655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.953740] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bdf4865-8345-4b82-90d0-927ef3d3cd2e is going to be updated. [ 1021.974744] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.975092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.975092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.975169] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.975313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.975469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bdf4865-8345-4b82-90d0-927ef3d3cd2e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.383954] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 1022.384225] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 deletion is rescheduled due to dependency. [ 1022.384366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.384753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.385044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.385334] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.385548] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.385652] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.385896] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.386023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.386166] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.443607] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac810154-f096-4495-a2c8-d43e5bb3d1a2: rpc.has_security_group_logging(os_id): False [ 1022.461131] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.461131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.461131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.461131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.461131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.461436] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.461436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.461436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.461547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.461576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.461841] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.461841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.461949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.462470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.462470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.462470] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.462470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.462692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.462692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.462748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.462829] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 1022.520712] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.520802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.520836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.521031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.521185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.534871] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 1022.888913] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.019505] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 in Status: SUCCESS [ 1023.019505] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 deletion is rescheduled due to dependency. [ 1023.019505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.392519] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.898309] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.898520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.898574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.898758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.898901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.899033] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 1023.927022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.927211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.927257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.927463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.927615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.937978] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 1024.554401] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 1024.554848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.949250] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 1025.949583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.950171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.950171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.950317] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.950374] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.950406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.950658] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.950658] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.950750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.950804] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.446890] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1026.446994] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1026.451797] env[69647]: INFO networking_nsxv3.common.synchronization [None req-c9eecc74-2aba-4f58-bf67-f0b941357090 tempest-AttachVolumeShelveTestJSON-989009573 tempest-AttachVolumeShelveTestJSON-989009573-project-member] Enqueued Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_rules [ 1026.452333] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_rules [ 1026.453339] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.453339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.453339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.453339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.453339] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.457031] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.459935] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.459935] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.459935] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.459935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.460754] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.460754] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.527541] env[69647]: INFO networking_nsxv3.common.synchronization [None req-6dbf199a-0953-4943-906d-2a09696197ef tempest-AttachVolumeShelveTestJSON-989009573 tempest-AttachVolumeShelveTestJSON-989009573-project-member] Enqueued Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_rules [ 1026.527977] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_rules [ 1026.528288] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.528407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.963225] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 326bee86-2025-4239-98be-95f9262ac7a3: rpc.has_security_group_logging(os_id): False [ 1026.982918] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.982918] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.982918] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.982918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.984752] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.984752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.984752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.984752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.984752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.984752] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 1026.986237] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.986455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.986593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.986886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.986960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.987999] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 already deleted. [ 1026.987999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.987999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.987999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.988310] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.048371] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.048450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.048490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.048669] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.048810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.062600] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 1027.509760] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.509760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.509760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.509760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.509760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.509760] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 already deleted. [ 1027.509760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.182697] env[69647]: INFO networking_nsxv3.common.synchronization [req-33e45d08-fd88-43ab-9e1f-3c662b321bf0 req-08007e61-c04d-415f-ae1b-592b6696348f tempest-ServerTagsTestJSON-1792580150 tempest-ServerTagsTestJSON-1792580150-project-member] Enqueued Resource ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 with Priority: HIGHEST for action security_group_members [ 1028.183269] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 with Priority: HIGHEST for action security_group_members [ 1028.183600] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6295f807-c8cc-45a3-b9fc-b308b1e64f78 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.183735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.183812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.184158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.184357] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.184482] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.184526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.184715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.184801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.184897] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6295f807-c8cc-45a3-b9fc-b308b1e64f78',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.535213] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-751 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.535766] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.535766] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.536499] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.536499] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.536702] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.536758] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.537156] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.537229] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.537486] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1028.537636] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1028.537792] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1028.537936] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1028.538201] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1028.538343] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1028.538498] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1028.558661] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1028.558661] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1028.558661] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1028.558661] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.559101] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-cc64951e-1a7c-4274-85e3-f65704447077 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.559227] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-cc64951e-1a7c-4274-85e3-f65704447077" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.559348] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-cc64951e-1a7c-4274-85e3-f65704447077" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.559661] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-cc64951e-1a7c-4274-85e3-f65704447077" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.559804] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc64951e-1a7c-4274-85e3-f65704447077',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.688328] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.688328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.688328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.688328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.688328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.688526] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.688607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.688686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.688870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.689519] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.689519] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 already deleted. [ 1028.689519] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.062388] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.062606] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.062736] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.063183] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.063248] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.063419] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port cc64951e-1a7c-4274-85e3-f65704447077 not found, creating... [ 1029.064050] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.064050] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.064208] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.064408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.064800] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.064967] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.065179] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.065266] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.065779] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.065779] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.065779] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: cc64951e-1a7c-4274-85e3-f65704447077 is going to be created. [ 1029.088677] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.088879] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.089049] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.089364] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.089615] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.089909] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-cc64951e-1a7c-4274-85e3-f65704447077" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.091383] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 1029.091581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.810028] env[69647]: INFO networking_nsxv3.common.synchronization [req-33e45d08-fd88-43ab-9e1f-3c662b321bf0 req-74a5a65c-b569-4362-b04c-bf7788255a93 service nova] Enqueued Resource ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 with Priority: HIGHEST for action security_group_rules [ 1029.810310] env[69647]: INFO networking_nsxv3.common.synchronization [req-33e45d08-fd88-43ab-9e1f-3c662b321bf0 req-74a5a65c-b569-4362-b04c-bf7788255a93 service nova] Enqueued Resource ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 with Priority: HIGHEST for action security_group_members [ 1029.810409] env[69647]: INFO networking_nsxv3.common.synchronization [req-33e45d08-fd88-43ab-9e1f-3c662b321bf0 req-74a5a65c-b569-4362-b04c-bf7788255a93 service nova] Enqueued Resource ID: cc64951e-1a7c-4274-85e3-f65704447077 with Priority: HIGHEST for action port [ 1029.810980] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 with Priority: HIGHEST for action security_group_rules [ 1029.811169] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 with Priority: HIGHEST for action security_group_members [ 1029.811229] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc64951e-1a7c-4274-85e3-f65704447077 with Priority: HIGHEST for action port [ 1029.811518] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6295f807-c8cc-45a3-b9fc-b308b1e64f78 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.811644] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.811689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.811940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.812467] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6295f807-c8cc-45a3-b9fc-b308b1e64f78',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.812945] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6295f807-c8cc-45a3-b9fc-b308b1e64f78 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.813089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.813182] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.813386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.813503] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.813880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.813880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.813880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.813880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.814053] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6295f807-c8cc-45a3-b9fc-b308b1e64f78',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.815494] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc64951e-1a7c-4274-85e3-f65704447077 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.815494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc64951e-1a7c-4274-85e3-f65704447077" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.815494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc64951e-1a7c-4274-85e3-f65704447077" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.815494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc64951e-1a7c-4274-85e3-f65704447077" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.819455] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc64951e-1a7c-4274-85e3-f65704447077',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.160375] env[69647]: INFO networking_nsxv3.common.synchronization [req-12dbb364-7c58-4441-9772-e453bbe4141f req-10ab822e-70e7-4d4b-a15f-8d07bb589065 tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_members [ 1030.160375] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGHEST for action security_group_members [ 1030.160571] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.160711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.160777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.161026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.161312] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.161400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.161474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.161940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.161940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.161940] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.323729] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6295f807-c8cc-45a3-b9fc-b308b1e64f78 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.323729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.323729] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6295f807-c8cc-45a3-b9fc-b308b1e64f78',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.323729] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc64951e-1a7c-4274-85e3-f65704447077 with status ACTIVE [ 1030.323729] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.323729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.323729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.323729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.323729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.323729] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.323729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.323729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.325227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.325443] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.326367] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.327359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.327359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.330631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.330631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.330631] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc64951e-1a7c-4274-85e3-f65704447077 is going to be updated. [ 1030.355504] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.355770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.355846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.356109] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.356335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.356579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc64951e-1a7c-4274-85e3-f65704447077" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.619895] env[69647]: INFO networking_nsxv3.common.synchronization [req-2af170f5-3a58-4abd-ae65-ef2e67428142 req-3454778f-80b0-4595-bdc9-358640a75e61 tempest-ServerRescueTestJSON-99266533 tempest-ServerRescueTestJSON-99266533-project-member] Enqueued Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1030.620904] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1030.621750] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.621875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.621936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.623151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.623151] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.623151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.623151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.623151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.623151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.623401] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.668778] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.668778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.668778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.668778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.668778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.668778] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.668778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.668778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.668778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.668778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.668778] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a is going to be updated. [ 1030.696660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.696847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.696847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.697122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.697296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.705632] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a in Status: IN_PROGRESS for 2s [ 1030.830993] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6295f807-c8cc-45a3-b9fc-b308b1e64f78',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.957592] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-767 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.957727] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-767" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.957784] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-767" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.958367] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-767" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.959169] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.961948] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.962242] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.962973] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.963238] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.963717] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.963717] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.963810] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.963842] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.963958] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.964081] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.964225] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.987589] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.987880] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1030.987880] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.988139] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-767" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.988552] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.988768] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.988861] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.989267] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.989601] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.125360] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.125550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.125641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.125879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.125976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.126256] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.126387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.126632] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.126632] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.126727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.126837] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce95814a-dc89-465e-b193-75e16b57b822 already deleted. [ 1031.126921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.332936] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.333069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.333160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.333397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.333489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.333595] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 is going to be created. [ 1031.359230] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.359474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.359474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.359645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.359827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.368912] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 in Status: UNINITIALIZED for 2s [ 1031.492614] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.492814] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.493305] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.493305] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.493305] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.493570] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc not found, creating... [ 1031.493991] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.494084] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.494159] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.494523] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.494523] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.495139] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.495139] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.495139] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.495330] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.495478] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.495570] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc is going to be created. [ 1031.515592] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.515860] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.515993] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.516301] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.516591] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.516867] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.227414] env[69647]: INFO networking_nsxv3.common.synchronization [req-2af170f5-3a58-4abd-ae65-ef2e67428142 req-84e6a210-8617-40eb-81c8-ff66c1dc2998 service nova] Enqueued Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_rules [ 1032.227678] env[69647]: INFO networking_nsxv3.common.synchronization [req-2af170f5-3a58-4abd-ae65-ef2e67428142 req-84e6a210-8617-40eb-81c8-ff66c1dc2998 service nova] Enqueued Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1032.227872] env[69647]: INFO networking_nsxv3.common.synchronization [req-2af170f5-3a58-4abd-ae65-ef2e67428142 req-84e6a210-8617-40eb-81c8-ff66c1dc2998 service nova] Enqueued Resource ID: b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc with Priority: HIGHEST for action port [ 1032.227964] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_rules [ 1032.228093] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1032.228188] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc with Priority: HIGHEST for action port [ 1032.230878] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.230878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.230878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.230878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.230878] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.232016] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.232016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.232016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.232253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.232474] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.232606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.232672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.232822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.232901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.232989] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.233791] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.233901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.233954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.235629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.235629] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.715627] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a in Status: SUCCESS [ 1032.715627] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a deletion is rescheduled due to dependency. [ 1032.715627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.736582] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.736582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.738094] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.738940] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc with status ACTIVE [ 1032.739265] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.739505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.739681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.740254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.740470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.742575] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.742575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.742575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.742575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.742575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.742575] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.742575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.742575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.742575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.742575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.742575] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc is going to be updated. [ 1032.767571] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.767739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.767812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.768048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.768172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.768360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b33d016d-d1b3-41dc-ba8c-3b451ebe5dfc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.239903] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.341415] env[69647]: INFO networking_nsxv3.common.synchronization [None req-21c6521f-0d91-48bc-8d11-47ee74322bed tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_rules [ 1033.341415] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_rules [ 1033.341415] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.341415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.341415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.343081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.343273] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.380209] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 in Status: SUCCESS [ 1033.381267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.381267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.381267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.381493] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.381553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.381587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.382484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.382484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.382484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.382484] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6295f807-c8cc-45a3-b9fc-b308b1e64f78',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.470680] env[69647]: INFO networking_nsxv3.common.synchronization [None req-6d6b5537-665f-46db-aed0-aee9e10378b6 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_rules [ 1033.471107] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_rules [ 1033.471974] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.472160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.743818] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.743818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.743818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.743818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.743818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.743818] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce95814a-dc89-465e-b193-75e16b57b822 is going to be created. [ 1033.764928] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.765085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.765156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.765360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.765615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.773919] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: UNINITIALIZED for 2s [ 1033.862528] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.862715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.862763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.862973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.863073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.863174] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b889aaff-9fca-4d8b-92bf-300934a13f44 already deleted. [ 1033.863257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.863414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.863581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.863663] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.884426] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6295f807-c8cc-45a3-b9fc-b308b1e64f78 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.884562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.884636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.884855] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.885059] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.885138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.885198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.885350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.885441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.885521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.885674] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6295f807-c8cc-45a3-b9fc-b308b1e64f78 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.885765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.885825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.885968] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.886123] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.886214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.886275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.886414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.886515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.886848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.886848] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6295f807-c8cc-45a3-b9fc-b308b1e64f78',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.389287] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6295f807-c8cc-45a3-b9fc-b308b1e64f78: rpc.has_security_group_logging(os_id): False [ 1034.391761] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.391948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.391948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.392193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.392284] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.392512] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b889aaff-9fca-4d8b-92bf-300934a13f44 already deleted. [ 1034.392653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.406302] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.406580] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.406580] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.409245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.409245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.409245] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.409245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.409245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.409245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.409245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.409245] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.409245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.409245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.409245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.409245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.409245] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.409245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.409744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.409744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.409744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.409744] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 is going to be created. [ 1034.466301] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.466301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.466301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.466301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.466697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.480599] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 in Status: IN_PROGRESS for 2s [ 1035.397686] env[69647]: INFO networking_nsxv3.common.synchronization [req-d83bec90-c8d7-491e-98d0-346b79496aaa req-7c20fa2f-ce3f-4e8f-9528-004d323cc4f3 tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1035.397686] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1035.397686] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.398161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.398161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.398709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.399449] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.399449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.399449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.400093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.400185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.400309] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.783290] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: SUCCESS [ 1035.783627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.783796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.784698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.784698] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.784698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.784698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.784698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.785095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.785095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.785095] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.902169] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.902373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.902459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.902706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.902795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.903054] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.903159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.904075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.904075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.904075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.904075] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 1035.935452] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.938018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.938018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.938018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.938018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.944713] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 1036.240185] env[69647]: INFO networking_nsxv3.common.synchronization [None req-6c4d10c3-6219-4048-86e3-b9b892cdf1e5 None None] Enqueued Resource ID: cb4edb79-e701-4cde-86d3-402b9de46398 with Priority: HIGHEST for action port [ 1036.240898] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb4edb79-e701-4cde-86d3-402b9de46398 with Priority: HIGHEST for action port [ 1036.245457] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb4edb79-e701-4cde-86d3-402b9de46398 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.245604] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb4edb79-e701-4cde-86d3-402b9de46398" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.245648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb4edb79-e701-4cde-86d3-402b9de46398" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.245932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb4edb79-e701-4cde-86d3-402b9de46398" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.246083] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb4edb79-e701-4cde-86d3-402b9de46398',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.287705] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.287705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.287924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.288019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.288187] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.288316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.288379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.288694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.288694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.288785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.288894] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.289022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.289071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.289367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.289367] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.289592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.289592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.289592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.289706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.289744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.289851] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.491960] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 in Status: SUCCESS [ 1036.492261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.749107] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb4edb79-e701-4cde-86d3-402b9de46398 [ 1036.749361] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.749499] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.749574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.749843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.749894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.749966] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb4edb79-e701-4cde-86d3-402b9de46398 already deleted. [ 1036.750058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb4edb79-e701-4cde-86d3-402b9de46398" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.794443] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce95814a-dc89-465e-b193-75e16b57b822: rpc.has_security_group_logging(os_id): False [ 1036.811676] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.811821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.811892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.812157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.812243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.812385] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.812518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.812581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.812727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.812858] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.812986] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.813125] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.813157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.813388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.813388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.813537] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.813627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.813834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.814024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.814108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.814206] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce95814a-dc89-465e-b193-75e16b57b822 is going to be created. [ 1036.869320] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.869532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.869615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.869823] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.870008] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.881058] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: IN_PROGRESS for 2s [ 1037.852411] env[69647]: INFO networking_nsxv3.common.synchronization [None req-ee77cd65-0517-4592-ae58-5f226fd889cf None None] Enqueued Resource ID: 9b3ce134-99f1-46ae-98e6-5a8d61e235b2 with Priority: HIGHEST for action port [ 1037.852730] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b3ce134-99f1-46ae-98e6-5a8d61e235b2 with Priority: HIGHEST for action port [ 1037.853670] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b3ce134-99f1-46ae-98e6-5a8d61e235b2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.853670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b3ce134-99f1-46ae-98e6-5a8d61e235b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.853670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b3ce134-99f1-46ae-98e6-5a8d61e235b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.853851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b3ce134-99f1-46ae-98e6-5a8d61e235b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.853917] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b3ce134-99f1-46ae-98e6-5a8d61e235b2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.960050] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 1037.960367] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 deletion is rescheduled due to dependency. [ 1037.960441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.359401] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b3ce134-99f1-46ae-98e6-5a8d61e235b2 [ 1038.359909] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.359909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.360027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.363822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.363822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.363822] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b3ce134-99f1-46ae-98e6-5a8d61e235b2 already deleted. [ 1038.363822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b3ce134-99f1-46ae-98e6-5a8d61e235b2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.894586] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: SUCCESS [ 1038.898019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.106697] env[69647]: INFO networking_nsxv3.common.synchronization [None req-717c30a9-28c8-4f18-a5d7-824a453b5fc1 None None] Enqueued Resource ID: 763a5fb8-e0ab-464b-852e-4fc1e83abcf4 with Priority: HIGHEST for action port [ 1039.107645] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763a5fb8-e0ab-464b-852e-4fc1e83abcf4 with Priority: HIGHEST for action port [ 1039.107966] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-763a5fb8-e0ab-464b-852e-4fc1e83abcf4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.108095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-763a5fb8-e0ab-464b-852e-4fc1e83abcf4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.108154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-763a5fb8-e0ab-464b-852e-4fc1e83abcf4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.108440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-763a5fb8-e0ab-464b-852e-4fc1e83abcf4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.108549] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('763a5fb8-e0ab-464b-852e-4fc1e83abcf4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.611846] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 763a5fb8-e0ab-464b-852e-4fc1e83abcf4 [ 1039.611846] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.611846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.611976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.612119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.612211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.612313] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:763a5fb8-e0ab-464b-852e-4fc1e83abcf4 already deleted. [ 1039.612395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-763a5fb8-e0ab-464b-852e-4fc1e83abcf4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.599777] env[69647]: INFO networking_nsxv3.common.synchronization [None req-1b89faed-2725-496b-8107-ec2e6bd6915b None None] Enqueued Resource ID: c4f5a8db-3166-4e63-bebc-ee596874abe0 with Priority: HIGHEST for action port [ 1040.600492] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4f5a8db-3166-4e63-bebc-ee596874abe0 with Priority: HIGHEST for action port [ 1040.600749] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4f5a8db-3166-4e63-bebc-ee596874abe0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.600854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4f5a8db-3166-4e63-bebc-ee596874abe0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.600986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4f5a8db-3166-4e63-bebc-ee596874abe0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.601268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4f5a8db-3166-4e63-bebc-ee596874abe0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.601348] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4f5a8db-3166-4e63-bebc-ee596874abe0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.103751] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4f5a8db-3166-4e63-bebc-ee596874abe0 [ 1041.104046] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.104205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.104287] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.104500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.104582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.104686] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4f5a8db-3166-4e63-bebc-ee596874abe0 already deleted. [ 1041.104772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4f5a8db-3166-4e63-bebc-ee596874abe0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.354870] env[69647]: INFO networking_nsxv3.common.synchronization [req-15a27476-5c85-4fd0-ae9b-c3ebe61ddaab req-0f9d5d90-5e8e-496d-b311-f54cba3f460a tempest-AttachVolumeShelveTestJSON-989009573 tempest-AttachVolumeShelveTestJSON-989009573-project-member] Enqueued Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_members [ 1041.355440] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_members [ 1041.358907] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.359275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.359379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.359651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.359843] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.359952] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.360022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.360179] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.360263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.360430] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.637273] env[69647]: INFO networking_nsxv3.common.synchronization [None req-7efc43b4-7c55-48b3-9393-f2405e4a813b tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_rules [ 1041.637812] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_rules [ 1041.638205] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.638636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.638636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.638711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.638779] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.724615] env[69647]: INFO networking_nsxv3.common.synchronization [None req-8e6c7302-4b9b-4b38-adef-35e4b76e8ae3 tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_rules [ 1041.724615] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_rules [ 1041.724615] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.724615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.863872] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.863872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.863872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.863872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.863872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.863872] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.863872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.863872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.863872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.863872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.863872] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 already deleted. [ 1041.863872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.014020] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.014020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.014020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.014020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.014477] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.014791] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.015065] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.015422] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.015694] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.016047] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.017035] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.017035] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.017035] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.017035] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.017035] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.017035] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.042215] env[69647]: INFO networking_nsxv3.common.synchronization [req-d0367396-88fe-4070-b2dd-d3e80128b09f req-df7ffcf7-1d07-4faa-aa12-1c73f26096d2 tempest-ImagesTestJSON-954996409 tempest-ImagesTestJSON-954996409-project-member] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 1042.042215] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.042331] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1042.042610] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.043169] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.044019] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-c1b4c161-88ce-4712-ab0f-d84411f44d32 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.044710] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.045301] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.046714] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.046714] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1b4c161-88ce-4712-ab0f-d84411f44d32',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.048027] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGHEST for action security_group_members [ 1042.048638] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.048888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.049062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.050028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.050028] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.050028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.050028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.050028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.050028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.050028] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.159501] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.159696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.159803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.159916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.159999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.160113] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 already deleted. [ 1042.160193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.160343] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.160564] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.160659] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.549584] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.549838] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.549966] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.550387] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.550579] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.550789] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port c1b4c161-88ce-4712-ab0f-d84411f44d32 not found, creating... [ 1042.551132] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.551341] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.551487] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.552137] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.552137] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.552357] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.553336] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.553336] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.553336] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.553336] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.553758] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: c1b4c161-88ce-4712-ab0f-d84411f44d32 is going to be created. [ 1042.555177] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.555270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.555379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.555649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.555841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.556070] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.556223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.556336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.556541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.556645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.556716] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be updated. [ 1042.576653] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.577840] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.577840] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.577840] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.578196] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.578511] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.584697] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.584854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.584915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.585155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.585297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.593173] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: IN_PROGRESS for 2s [ 1042.688563] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.688563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.688563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.688563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.689198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.689198] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 already deleted. [ 1042.689198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.441092] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec9a3116-c923-4f39-83d5-955fde79a549 req-1c414e84-1563-4d66-9072-b02b5b563aa3 tempest-ServerTagsTestJSON-1792580150 tempest-ServerTagsTestJSON-1792580150-project-member] Enqueued Resource ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 with Priority: HIGHEST for action security_group_members [ 1043.441705] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 with Priority: HIGHEST for action security_group_members [ 1043.442279] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6295f807-c8cc-45a3-b9fc-b308b1e64f78 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.442382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.442382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.442617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.443224] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.443224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.443224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.443224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.444196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.444196] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6295f807-c8cc-45a3-b9fc-b308b1e64f78',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.491605] env[69647]: INFO networking_nsxv3.common.synchronization [req-15a27476-5c85-4fd0-ae9b-c3ebe61ddaab req-aef1ef36-c6ba-414d-9d7b-433faf542ef7 service nova] Enqueued Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_rules [ 1043.492288] env[69647]: INFO networking_nsxv3.common.synchronization [req-15a27476-5c85-4fd0-ae9b-c3ebe61ddaab req-aef1ef36-c6ba-414d-9d7b-433faf542ef7 service nova] Enqueued Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_members [ 1043.492288] env[69647]: INFO networking_nsxv3.common.synchronization [req-15a27476-5c85-4fd0-ae9b-c3ebe61ddaab req-aef1ef36-c6ba-414d-9d7b-433faf542ef7 service nova] Enqueued Resource ID: c1b4c161-88ce-4712-ab0f-d84411f44d32 with Priority: HIGHEST for action port [ 1043.492288] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_rules [ 1043.492288] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_members [ 1043.492537] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b4c161-88ce-4712-ab0f-d84411f44d32 with Priority: HIGHEST for action port [ 1043.493240] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.493397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.493397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.493677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.493677] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.494558] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.494674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.494744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.495707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.495707] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.495707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.495707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.495707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.495707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.495707] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.496202] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1b4c161-88ce-4712-ab0f-d84411f44d32 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.496328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.496364] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.496500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.498361] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1b4c161-88ce-4712-ab0f-d84411f44d32',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.674883] env[69647]: INFO networking_nsxv3.common.synchronization [req-3652bcc9-f75a-4694-b14c-a40de517c288 req-86d7fd3d-25c1-4013-84c7-99933bf37a64 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1043.675421] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1043.675999] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.676219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.676294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.676556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.677635] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.677805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.677879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.678081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.678181] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.678251] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.946473] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.946756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.946756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.946894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.946982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.947191] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.947290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.947349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.947496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.947571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.947660] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 is going to be updated. [ 1043.974976] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.975171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.975244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.975675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.975675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.983174] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 in Status: IN_PROGRESS for 2s [ 1043.998654] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.998770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.000083] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.000907] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1b4c161-88ce-4712-ab0f-d84411f44d32 with status ACTIVE [ 1044.002139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.002139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.002139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.002139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.002139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.002139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.002139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.002139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.002139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.002139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.002475] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.002475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.002475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.002641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.002641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.002708] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1b4c161-88ce-4712-ab0f-d84411f44d32 is going to be updated. [ 1044.019887] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.020026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.020080] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.020244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.020344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.020490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.078218] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.078423] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.078550] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.078804] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.079072] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.079231] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.079349] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.079559] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.079703] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.079912] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.080038] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.080152] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.080264] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.080377] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.080485] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.080650] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.111692] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.111864] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1044.112013] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.112193] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.112491] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-c224d0d2-ac22-4796-9c01-c325554fa2e4 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.112792] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-c224d0d2-ac22-4796-9c01-c325554fa2e4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.112995] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-c224d0d2-ac22-4796-9c01-c325554fa2e4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.113532] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-c224d0d2-ac22-4796-9c01-c325554fa2e4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.113532] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c224d0d2-ac22-4796-9c01-c325554fa2e4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.182148] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.182309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.182384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.182632] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.182750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.182949] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.183061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.183123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.183353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.183353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.183431] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b889aaff-9fca-4d8b-92bf-300934a13f44 already deleted. [ 1044.183510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.504240] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.601969] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 in Status: SUCCESS [ 1044.602171] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 deletion is rescheduled due to dependency. [ 1044.602288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.616202] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.616441] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.616553] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.616839] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.616993] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.617161] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port c224d0d2-ac22-4796-9c01-c325554fa2e4 not found, creating... [ 1044.617420] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.617578] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.617696] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.617928] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.618075] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.618727] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.618727] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.618727] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.618888] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.619161] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.619289] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: c224d0d2-ac22-4796-9c01-c325554fa2e4 is going to be created. [ 1044.637716] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.637929] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.638230] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.638375] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.638557] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.638795] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-c224d0d2-ac22-4796-9c01-c325554fa2e4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.007210] env[69647]: INFO networking_nsxv3.common.synchronization [req-bb71d22f-6cb3-4be3-8c75-a6442cdc80c3 req-c5192978-870c-4915-885b-8f24cdbe96ab tempest-ServersNegativeTestJSON-2024807649 tempest-ServersNegativeTestJSON-2024807649-project-member] Enqueued Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 1045.008285] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.008454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.008564] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.008813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.008917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.009055] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 is going to be created. [ 1045.010595] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 with Priority: HIGHEST for action security_group_members [ 1045.011458] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e1872-1ae4-4c49-8159-ec39c82e2868 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.011592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.011684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.011894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.012525] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.012606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.012682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.012861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.012940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.013076] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e1872-1ae4-4c49-8159-ec39c82e2868',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.035039] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.035039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.035039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.035039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.035275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.046103] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 in Status: UNINITIALIZED for 2s [ 1045.375118] env[69647]: INFO networking_nsxv3.common.synchronization [req-3652bcc9-f75a-4694-b14c-a40de517c288 req-f6998bee-437d-4ffe-b003-bc3c1e1144f8 service nova] Enqueued Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_rules [ 1045.375366] env[69647]: INFO networking_nsxv3.common.synchronization [req-3652bcc9-f75a-4694-b14c-a40de517c288 req-f6998bee-437d-4ffe-b003-bc3c1e1144f8 service nova] Enqueued Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1045.375532] env[69647]: INFO networking_nsxv3.common.synchronization [req-3652bcc9-f75a-4694-b14c-a40de517c288 req-f6998bee-437d-4ffe-b003-bc3c1e1144f8 service nova] Enqueued Resource ID: c224d0d2-ac22-4796-9c01-c325554fa2e4 with Priority: HIGHEST for action port [ 1045.376632] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_rules [ 1045.377562] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1045.377795] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c224d0d2-ac22-4796-9c01-c325554fa2e4 with Priority: HIGHEST for action port [ 1045.378188] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.378424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.378555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.378867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.379091] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.380663] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.380827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.380978] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.381313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.381927] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.382432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.382688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.382823] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.382909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.383027] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.385137] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c224d0d2-ac22-4796-9c01-c325554fa2e4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.385137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c224d0d2-ac22-4796-9c01-c325554fa2e4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.385498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c224d0d2-ac22-4796-9c01-c325554fa2e4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.385635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c224d0d2-ac22-4796-9c01-c325554fa2e4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.385635] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c224d0d2-ac22-4796-9c01-c325554fa2e4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.515887] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.516045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.516117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.516334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.516420] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.516611] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.516971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.516971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.516971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.517147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.517147] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 is going to be updated. [ 1045.547572] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.547809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.548014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.548144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.548290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.557723] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: IN_PROGRESS for 2s [ 1045.885460] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.889013] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.889013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.889013] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c224d0d2-ac22-4796-9c01-c325554fa2e4 with status ACTIVE [ 1045.889013] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.889013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.889013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.889013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.889013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.889013] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.889013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.889606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.889606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.889606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.889606] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.889606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.889606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.889821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.889821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.889924] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c224d0d2-ac22-4796-9c01-c325554fa2e4 is going to be updated. [ 1045.909518] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.909518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.909668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.909743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.909885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.910074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c224d0d2-ac22-4796-9c01-c325554fa2e4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.992231] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 in Status: SUCCESS [ 1045.992422] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6295f807-c8cc-45a3-b9fc-b308b1e64f78 deletion is rescheduled due to dependency. [ 1045.992547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6295f807-c8cc-45a3-b9fc-b308b1e64f78" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.387528] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.891684] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.891838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.891920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.892200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.892295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.892399] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b889aaff-9fca-4d8b-92bf-300934a13f44 is going to be created. [ 1046.914427] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.914566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.914608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.914883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.915092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.925177] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: UNINITIALIZED for 2s [ 1047.054894] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 in Status: SUCCESS [ 1047.055139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.055311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.055528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.055717] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.055833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.055898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.056061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.056142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.056411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.056411] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.505693] env[69647]: INFO networking_nsxv3.common.synchronization [req-81e6ca6f-0439-42ae-af10-30225be283dd req-1e813726-6df8-41d1-b4d2-48284aa067b3 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1047.505693] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1047.506120] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.506120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.506120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.506353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.506727] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.506727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.506918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.506918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.507029] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.559784] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.569674] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 in Status: SUCCESS [ 1047.569842] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e1872-1ae4-4c49-8159-ec39c82e2868 deletion is rescheduled due to dependency. [ 1047.569946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e1872-1ae4-4c49-8159-ec39c82e2868" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.866025] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-827 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.866179] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-827" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.866226] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-827" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.866706] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-827" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.867054] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.867147] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.867263] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.867563] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.867746] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.867966] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.868237] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.868237] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.868373] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.868425] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.868506] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.868641] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.888074] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.888310] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1047.888390] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.888713] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-827" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.888942] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.889130] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.889255] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.889581] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.889802] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.009511] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.009674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.009738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.010589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.010589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.010589] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.010589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.010589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.010589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.010589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.011009] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c already deleted. [ 1048.011009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.061448] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190: rpc.has_security_group_logging(os_id): False [ 1048.082798] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.082798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.082798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.082798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.082798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.082798] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.082798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.082798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.082798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.082798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.082798] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 is going to be created. [ 1048.160326] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.160469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.160536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.160758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.160934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.176700] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 in Status: IN_PROGRESS for 2s [ 1048.391808] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.392099] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.392252] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.392595] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.392880] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.393039] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e not found, creating... [ 1048.393390] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.393569] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.393732] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.393999] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.394187] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.394529] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.394711] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.394836] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.395109] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.395279] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.395448] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e is going to be created. [ 1048.413961] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.414221] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.414355] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.414656] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.414892] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.415172] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.934254] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: SUCCESS [ 1048.934556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.934648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.934863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.935182] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.935182] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.935317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.935399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.935470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.935557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.935648] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.103983] env[69647]: INFO networking_nsxv3.common.synchronization [req-81e6ca6f-0439-42ae-af10-30225be283dd req-ddc44b23-38d6-4070-9d2c-b33305bef61d service nova] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1049.104075] env[69647]: INFO networking_nsxv3.common.synchronization [req-81e6ca6f-0439-42ae-af10-30225be283dd req-ddc44b23-38d6-4070-9d2c-b33305bef61d service nova] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1049.104211] env[69647]: INFO networking_nsxv3.common.synchronization [req-81e6ca6f-0439-42ae-af10-30225be283dd req-ddc44b23-38d6-4070-9d2c-b33305bef61d service nova] Enqueued Resource ID: ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e with Priority: HIGHEST for action port [ 1049.104453] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1049.104580] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1049.104677] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e with Priority: HIGHEST for action port [ 1049.107320] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.107320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.107320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.107320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.107320] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.108098] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.108172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.108208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.108405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.108555] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.110836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.110836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.110836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.110836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.110836] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.110836] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.110836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.110836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.110836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.110836] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.437991] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.612191] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.612369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.612475] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.613676] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e with status ACTIVE [ 1049.613862] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.613989] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.614101] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.617057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.617057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.617057] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.617057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.617057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.617057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.617057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.617057] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.617057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.617057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.617057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.617057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.617057] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e is going to be updated. [ 1049.636913] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.637161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.637161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.637336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.637468] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.637647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.874604] env[69647]: INFO networking_nsxv3.common.synchronization [req-dd8041d1-2120-4e52-8251-849ea4f7f54f req-94775283-53cf-48af-9cfc-df923b4ffdcb tempest-ImagesOneServerNegativeTestJSON-126282846 tempest-ImagesOneServerNegativeTestJSON-126282846-project-member] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1049.875161] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1049.875496] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.875618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.875691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.875966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.876150] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.876257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.876317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.876471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.876553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.876678] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.940063] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b889aaff-9fca-4d8b-92bf-300934a13f44: rpc.has_security_group_logging(os_id): False [ 1049.960213] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.960297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.960297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.960502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.960633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.960844] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.960941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.961031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.961186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.961256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.961348] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b889aaff-9fca-4d8b-92bf-300934a13f44 is going to be created. [ 1050.021063] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.021422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.021422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.021684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.021962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.034652] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: IN_PROGRESS for 2s [ 1050.118223] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.166959] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.167250] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.167520] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.167859] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.168156] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.168327] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.168455] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.168695] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.168850] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.169086] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.169207] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.169369] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.169436] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.169556] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.169633] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.169774] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.188841] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 in Status: SUCCESS [ 1050.188841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.191042] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.191042] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1050.191042] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.191042] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.191300] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-73dddc70-3c91-40eb-b764-5da437cb5b07 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.191300] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-73dddc70-3c91-40eb-b764-5da437cb5b07" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.191478] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-73dddc70-3c91-40eb-b764-5da437cb5b07" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.191824] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-73dddc70-3c91-40eb-b764-5da437cb5b07" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.192363] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73dddc70-3c91-40eb-b764-5da437cb5b07',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.378959] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.379144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.379220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.379437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.379529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.379743] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.379841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.379905] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.380073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.380149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.380236] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 already deleted. [ 1050.380316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.620731] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.620917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.620984] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.621229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.621318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.621779] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be created. [ 1050.643106] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.643247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.643330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.643500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.643658] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.651646] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: UNINITIALIZED for 2s [ 1050.695150] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.695377] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.695514] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.695794] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.695944] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.696116] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 73dddc70-3c91-40eb-b764-5da437cb5b07 not found, creating... [ 1050.696382] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.696543] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.696661] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.696884] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.697025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.697348] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.697515] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.697633] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.697844] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.698024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.698143] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 73dddc70-3c91-40eb-b764-5da437cb5b07 is going to be created. [ 1050.715343] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.715611] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.715809] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.716117] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.716399] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.716670] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-73dddc70-3c91-40eb-b764-5da437cb5b07" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.425629] env[69647]: INFO networking_nsxv3.common.synchronization [req-dd8041d1-2120-4e52-8251-849ea4f7f54f req-9c0126b6-28b6-4c26-8dda-d3e20412516a service nova] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_rules [ 1051.425934] env[69647]: INFO networking_nsxv3.common.synchronization [req-dd8041d1-2120-4e52-8251-849ea4f7f54f req-9c0126b6-28b6-4c26-8dda-d3e20412516a service nova] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1051.426018] env[69647]: INFO networking_nsxv3.common.synchronization [req-dd8041d1-2120-4e52-8251-849ea4f7f54f req-9c0126b6-28b6-4c26-8dda-d3e20412516a service nova] Enqueued Resource ID: 73dddc70-3c91-40eb-b764-5da437cb5b07 with Priority: HIGHEST for action port [ 1051.426247] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_rules [ 1051.426392] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1051.426473] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73dddc70-3c91-40eb-b764-5da437cb5b07 with Priority: HIGHEST for action port [ 1051.427056] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.428327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.428327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.428327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.428327] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.428655] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.428655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.428655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.428884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.429230] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.429342] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.429401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.429543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.429628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.429718] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.430450] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-73dddc70-3c91-40eb-b764-5da437cb5b07 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.432102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73dddc70-3c91-40eb-b764-5da437cb5b07" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.432102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73dddc70-3c91-40eb-b764-5da437cb5b07" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.432102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73dddc70-3c91-40eb-b764-5da437cb5b07" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.432102] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73dddc70-3c91-40eb-b764-5da437cb5b07',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.933200] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.933349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.933519] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.934483] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73dddc70-3c91-40eb-b764-5da437cb5b07 with status ACTIVE [ 1051.934651] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.934651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.934740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.935071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.935071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.935280] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.935387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.935463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.935607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.935685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.935878] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.936138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.936138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.936288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.936288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.936349] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73dddc70-3c91-40eb-b764-5da437cb5b07 is going to be updated. [ 1051.955806] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.955898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.956523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.956523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.956523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.956523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73dddc70-3c91-40eb-b764-5da437cb5b07" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.046586] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: SUCCESS [ 1052.046820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.438730] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.661053] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1052.661053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.661385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.661498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.661595] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.661714] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.661775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.661926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.662570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.662570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.662570] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.940995] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.941208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.941269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.941486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.941582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.941688] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 is going to be created. [ 1052.963427] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.963643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.963643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.964078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.964078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.972512] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: UNINITIALIZED for 2s [ 1053.164277] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.164520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.164583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.165092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.165092] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.165254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.165254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.165361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.165451] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.165561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.167234] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.167234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.167234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.167234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.167234] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.167234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.167234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.167234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.167234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.167234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.167234] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.671426] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d20c2212-5440-4d22-b2b5-94431ba7f51c: rpc.has_security_group_logging(os_id): False [ 1053.688358] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.688358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.689180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.689180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.689180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.689180] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.689180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.689180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.690493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.690493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.690493] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.690493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.690493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.690493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.690493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.690493] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.690493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.690493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.690493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.691052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.691052] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be created. [ 1053.745377] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.745540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.745617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.745796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.745977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.756697] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1054.281043] env[69647]: INFO networking_nsxv3.common.synchronization [req-11079769-399a-498a-9e66-85272205c036 req-3426f158-4103-4067-98b5-330582119162 tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_members [ 1054.281043] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_members [ 1054.281043] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.281043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.281043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.281043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.281043] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.281043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.281043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.281043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.281043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.281481] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.789488] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.789488] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.789488] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.789898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.789898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.790434] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.790434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.790434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.790607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.790607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.790607] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 already deleted. [ 1054.790711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.897780] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-451 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.897988] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.898133] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.898395] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.898648] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.898805] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.898927] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.899482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.899719] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.899945] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.900088] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.900206] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.900320] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.900436] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.900547] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.900685] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.920034] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.920034] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1054.920034] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.920353] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.920546] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-4884e227-6e16-4040-8ef4-940811f7dd3b taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.920643] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-4884e227-6e16-4040-8ef4-940811f7dd3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.921195] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-4884e227-6e16-4040-8ef4-940811f7dd3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.921328] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-4884e227-6e16-4040-8ef4-940811f7dd3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.921378] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4884e227-6e16-4040-8ef4-940811f7dd3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.981877] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: SUCCESS [ 1054.982067] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.982286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.982558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.983119] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.983119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.983119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.983270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.983302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.984135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.984135] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.424510] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.424510] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.424510] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.424510] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.425701] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.425701] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 4884e227-6e16-4040-8ef4-940811f7dd3b not found, creating... [ 1055.425701] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.425701] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.425701] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.431078] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.431078] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.431078] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.431078] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.431078] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.431078] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.431078] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.431078] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 4884e227-6e16-4040-8ef4-940811f7dd3b is going to be created. [ 1055.452742] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.452742] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.452742] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.453260] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.453367] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.453595] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-4884e227-6e16-4040-8ef4-940811f7dd3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.489028] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.489028] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.489028] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.489028] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.489028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.490152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.490152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.490152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.490152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.490152] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.777419] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1055.777419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.991680] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b0043ff-d285-4932-aeae-115f9e86d947: rpc.has_security_group_logging(os_id): False [ 1056.008843] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.009138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.009179] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.009573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.009681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.009880] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.009984] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.010061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.010227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.010306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.010512] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.010624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.010662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.010802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.010860] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.011087] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.011185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.011246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.011385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.011465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.011555] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 is going to be created. [ 1056.064823] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.065271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.065383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.065625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.065836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.077659] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: IN_PROGRESS for 2s [ 1056.600916] env[69647]: INFO networking_nsxv3.common.synchronization [req-11079769-399a-498a-9e66-85272205c036 req-83a59250-6c6d-4ac2-9ef5-e91a55786c52 service nova] Enqueued Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_rules [ 1056.601265] env[69647]: INFO networking_nsxv3.common.synchronization [req-11079769-399a-498a-9e66-85272205c036 req-83a59250-6c6d-4ac2-9ef5-e91a55786c52 service nova] Enqueued Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_members [ 1056.601433] env[69647]: INFO networking_nsxv3.common.synchronization [req-11079769-399a-498a-9e66-85272205c036 req-83a59250-6c6d-4ac2-9ef5-e91a55786c52 service nova] Enqueued Resource ID: 4884e227-6e16-4040-8ef4-940811f7dd3b with Priority: HIGHEST for action port [ 1056.602175] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_rules [ 1056.602653] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_members [ 1056.602874] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4884e227-6e16-4040-8ef4-940811f7dd3b with Priority: HIGHEST for action port [ 1056.603682] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.603682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.603682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.603682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.603939] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.605167] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.606602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.606683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.609294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.609871] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.609871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.609871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.610055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.610153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.610285] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.611997] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-4884e227-6e16-4040-8ef4-940811f7dd3b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.611997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4884e227-6e16-4040-8ef4-940811f7dd3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.611997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4884e227-6e16-4040-8ef4-940811f7dd3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.611997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4884e227-6e16-4040-8ef4-940811f7dd3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.611997] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4884e227-6e16-4040-8ef4-940811f7dd3b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.116875] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.116875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.117196] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.118568] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4884e227-6e16-4040-8ef4-940811f7dd3b with status ACTIVE [ 1057.118568] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.118568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.118568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.118568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.118568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.118869] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.118869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.118869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.119157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.119157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.119275] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.119348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.119395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.119527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.119714] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.119714] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4884e227-6e16-4040-8ef4-940811f7dd3b is going to be updated. [ 1057.123544] env[69647]: INFO networking_nsxv3.common.synchronization [req-2bb545ac-7788-4b77-a05e-a0862b1029bf req-de63a0ec-3686-426c-b328-344b0c48fa3d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1057.123709] env[69647]: INFO networking_nsxv3.common.synchronization [req-2bb545ac-7788-4b77-a05e-a0862b1029bf req-de63a0ec-3686-426c-b328-344b0c48fa3d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_members [ 1057.124223] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1057.124461] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_members [ 1057.124734] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.124838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.124838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.124999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.125152] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.125301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.125301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.125600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.125600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.125600] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.126407] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.126552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.126756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.126890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.126947] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.127029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.127085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.127269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.127356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.127456] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.140906] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.142277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.142368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.142577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.143059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.143059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4884e227-6e16-4040-8ef4-940811f7dd3b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.178308] env[69647]: INFO networking_nsxv3.common.synchronization [None req-20b29a80-e184-4620-a1b9-cadb807bbc80 None None] Enqueued Resource ID: 09d2c4de-4a62-4979-a48b-a46c3fe778ce with Priority: HIGHEST for action port [ 1057.178308] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09d2c4de-4a62-4979-a48b-a46c3fe778ce with Priority: HIGHEST for action port [ 1057.178784] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-09d2c4de-4a62-4979-a48b-a46c3fe778ce taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.178912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09d2c4de-4a62-4979-a48b-a46c3fe778ce" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.178980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09d2c4de-4a62-4979-a48b-a46c3fe778ce" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.179423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09d2c4de-4a62-4979-a48b-a46c3fe778ce" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.179423] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09d2c4de-4a62-4979-a48b-a46c3fe778ce',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.221945] env[69647]: INFO networking_nsxv3.common.synchronization [req-2bb545ac-7788-4b77-a05e-a0862b1029bf req-de63a0ec-3686-426c-b328-344b0c48fa3d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1057.222019] env[69647]: INFO networking_nsxv3.common.synchronization [req-2bb545ac-7788-4b77-a05e-a0862b1029bf req-de63a0ec-3686-426c-b328-344b0c48fa3d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1057.222149] env[69647]: INFO networking_nsxv3.common.synchronization [req-2bb545ac-7788-4b77-a05e-a0862b1029bf req-de63a0ec-3686-426c-b328-344b0c48fa3d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_rules [ 1057.222905] env[69647]: INFO networking_nsxv3.common.synchronization [req-2bb545ac-7788-4b77-a05e-a0862b1029bf req-de63a0ec-3686-426c-b328-344b0c48fa3d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_members [ 1057.222905] env[69647]: INFO networking_nsxv3.common.synchronization [req-2bb545ac-7788-4b77-a05e-a0862b1029bf req-de63a0ec-3686-426c-b328-344b0c48fa3d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e with Priority: HIGHEST for action port [ 1057.223136] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1057.223176] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_rules [ 1057.223254] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e with Priority: HIGHEST for action port [ 1057.223349] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1057.223440] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_members [ 1057.224307] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.224307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.224307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.224307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.224656] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.225616] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e760e2e0-3e38-4b10-a3c7-8fe274472ed2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.225616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.225616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.225810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.225847] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.226871] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.226989] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.227076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.227239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.227313] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.228030] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.228142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.228405] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.228491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.622087] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.628807] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.633263] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.687018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09d2c4de-4a62-4979-a48b-a46c3fe778ce [ 1057.687018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.687018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.687018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.687018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.687018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.687018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09d2c4de-4a62-4979-a48b-a46c3fe778ce already deleted. [ 1057.687018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09d2c4de-4a62-4979-a48b-a46c3fe778ce" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.729952] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e with status ACTIVE [ 1057.730568] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.730568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.730758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.730961] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.731117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.731367] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.731516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.731612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.731967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.731967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.732220] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.732363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.732457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.732665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.732812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.732900] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e is going to be updated. [ 1057.736501] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.736501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.736501] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.736501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.757120] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.757120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.757120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.757120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.757120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.757120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.962434] env[69647]: INFO networking_nsxv3.common.synchronization [req-61992ec5-e96f-4b93-9225-9978418a1ffb req-b7eae8fe-4cab-489c-9bff-dd0dcb98942d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1057.962615] env[69647]: INFO networking_nsxv3.common.synchronization [req-61992ec5-e96f-4b93-9225-9978418a1ffb req-b7eae8fe-4cab-489c-9bff-dd0dcb98942d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_members [ 1057.962812] env[69647]: INFO networking_nsxv3.common.synchronization [req-61992ec5-e96f-4b93-9225-9978418a1ffb req-b7eae8fe-4cab-489c-9bff-dd0dcb98942d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGHEST for action security_group_members [ 1057.967774] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1057.967840] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_members [ 1057.967943] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGHEST for action security_group_members [ 1057.968262] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.968369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.968569] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.968660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.968829] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-521d23d6-a304-4823-bf14-9899102d1eac taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.968929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.968996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.969280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.969428] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.969656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.969656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.969745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.969797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.969893] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.092830] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: SUCCESS [ 1058.093224] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.124915] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.124915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.124915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.124915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.124915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.124915] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 is going to be created. [ 1058.131702] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.136453] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.147834] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.147995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.148114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.148355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.148749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.158880] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 in Status: UNINITIALIZED for 2s [ 1058.170075] env[69647]: INFO networking_nsxv3.common.synchronization [req-61992ec5-e96f-4b93-9225-9978418a1ffb req-b7eae8fe-4cab-489c-9bff-dd0dcb98942d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGHEST for action security_group_rules [ 1058.170264] env[69647]: INFO networking_nsxv3.common.synchronization [req-61992ec5-e96f-4b93-9225-9978418a1ffb req-b7eae8fe-4cab-489c-9bff-dd0dcb98942d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGHEST for action security_group_members [ 1058.170402] env[69647]: INFO networking_nsxv3.common.synchronization [req-61992ec5-e96f-4b93-9225-9978418a1ffb req-b7eae8fe-4cab-489c-9bff-dd0dcb98942d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1058.170594] env[69647]: INFO networking_nsxv3.common.synchronization [req-61992ec5-e96f-4b93-9225-9978418a1ffb req-b7eae8fe-4cab-489c-9bff-dd0dcb98942d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1058.170663] env[69647]: INFO networking_nsxv3.common.synchronization [req-61992ec5-e96f-4b93-9225-9978418a1ffb req-b7eae8fe-4cab-489c-9bff-dd0dcb98942d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_rules [ 1058.170770] env[69647]: INFO networking_nsxv3.common.synchronization [req-61992ec5-e96f-4b93-9225-9978418a1ffb req-b7eae8fe-4cab-489c-9bff-dd0dcb98942d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_members [ 1058.170948] env[69647]: INFO networking_nsxv3.common.synchronization [req-61992ec5-e96f-4b93-9225-9978418a1ffb req-b7eae8fe-4cab-489c-9bff-dd0dcb98942d tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e with Priority: HIGHEST for action port [ 1058.172274] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGHEST for action security_group_rules [ 1058.172511] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1058.172775] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_members [ 1058.172959] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e with Priority: HIGHEST for action port [ 1058.173118] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_rules [ 1058.173270] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGHEST for action security_group_members [ 1058.173392] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1058.174245] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521d23d6-a304-4823-bf14-9899102d1eac taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.174347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.174455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.174788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.174929] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.175927] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.176086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.176365] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.176429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.176631] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.177291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.177291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.177448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.177565] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.179306] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e760e2e0-3e38-4b10-a3c7-8fe274472ed2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.179306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.179552] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-521d23d6-a304-4823-bf14-9899102d1eac taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.179690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.179965] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.180109] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.472038] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.637089] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.637089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.637089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.637089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.637089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.637089] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1058.640392] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.640673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.640755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.641047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.641136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.641230] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 is going to be created. [ 1058.658645] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.658857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.658857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.659125] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.659325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.661867] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.662028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.662097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.662255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.662395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.671703] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1058.672370] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: UNINITIALIZED for 2s [ 1058.681089] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-521d23d6-a304-4823-bf14-9899102d1eac taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.681316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.683580] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e with status ACTIVE [ 1058.683811] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.683952] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.684047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.684301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.684416] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.684625] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.684741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.684824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.685133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.685133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.685347] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.685494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.685572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.685737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.685846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.685933] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e is going to be updated. [ 1058.703550] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.703690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.703757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.703948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.704091] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.704279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec28e8b0-3abe-4a8f-9bc6-ad481b1e133e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.975123] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.243785] env[69647]: INFO networking_nsxv3.common.synchronization [None req-26ad3d74-88b3-4d5a-bcce-80d20793fc9e tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_rules [ 1059.243785] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_rules [ 1059.243785] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.244661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.244890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.245344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.245762] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.321232] env[69647]: INFO networking_nsxv3.common.synchronization [None req-f4ea34b0-b2cb-4c76-9fe6-6cfd28c2839b tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_rules [ 1059.321232] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_rules [ 1059.322074] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.322431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.478386] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.478386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.478386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.479021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.479259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.479458] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521d23d6-a304-4823-bf14-9899102d1eac is going to be created. [ 1059.506106] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.506106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.506106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.506106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.506106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.513718] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521d23d6-a304-4823-bf14-9899102d1eac in Status: UNINITIALIZED for 2s [ 1059.593929] env[69647]: INFO networking_nsxv3.common.synchronization [None req-698d0308-5fe3-42ef-8fbb-7792d120bce9 None None] Enqueued Resource ID: fdd9c234-6149-4cb8-b873-ab299b77b2b1 with Priority: HIGHEST for action port [ 1059.595021] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdd9c234-6149-4cb8-b873-ab299b77b2b1 with Priority: HIGHEST for action port [ 1059.595021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdd9c234-6149-4cb8-b873-ab299b77b2b1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.595300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdd9c234-6149-4cb8-b873-ab299b77b2b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.595469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdd9c234-6149-4cb8-b873-ab299b77b2b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.595950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdd9c234-6149-4cb8-b873-ab299b77b2b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.597013] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdd9c234-6149-4cb8-b873-ab299b77b2b1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.766080] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.766234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.766310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.766868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.767035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.767126] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b81759fd-827f-4158-bff1-7caece3251c2 already deleted. [ 1059.767216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.767376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.767551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.767634] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.098866] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdd9c234-6149-4cb8-b873-ab299b77b2b1 [ 1060.099166] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.099380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.099380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.099593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.099791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.099791] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdd9c234-6149-4cb8-b873-ab299b77b2b1 already deleted. [ 1060.099885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdd9c234-6149-4cb8-b873-ab299b77b2b1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.167823] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 in Status: SUCCESS [ 1060.167823] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.168034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.168714] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.169205] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.169420] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.169704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.169988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.170171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.170252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.170389] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.288469] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.288773] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.292066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.292345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.292440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.292547] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b81759fd-827f-4158-bff1-7caece3251c2 already deleted. [ 1060.292635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.453542] env[69647]: INFO networking_nsxv3.common.synchronization [req-56bb5e8c-a4a5-4081-87af-7ecbe30c39bd req-5fe1e33f-2202-4f42-b055-0756b93fe73e tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1060.453542] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1060.455357] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.455357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.455357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.455706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.455759] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.459024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.459024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.459024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.459024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.459024] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.675761] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.685430] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: SUCCESS [ 1060.685430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.685653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.685653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.686013] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.686013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.686013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.686367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.686367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.686367] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.689254] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1060.689254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.689254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.689254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.689254] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.689254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.689254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.689254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.689254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.689254] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.870138] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.870584] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.870805] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.871162] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.872569] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.872769] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.872898] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.873241] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.873410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.873643] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.873756] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.873867] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.874011] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.874136] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.874251] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.874390] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.894510] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.894731] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1060.894888] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.895094] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-808" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.895471] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-d82457a1-a20e-4aae-b42a-3603d54a6baf taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.895666] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-d82457a1-a20e-4aae-b42a-3603d54a6baf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.895790] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-d82457a1-a20e-4aae-b42a-3603d54a6baf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.896173] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-d82457a1-a20e-4aae-b42a-3603d54a6baf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.896326] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d82457a1-a20e-4aae-b42a-3603d54a6baf',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.958541] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.959113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.959113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.959113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.959248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.963021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.963021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.963021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.963021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.963021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.963021] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 1060.987818] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.988065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.988148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.989724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.989724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.998041] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 1061.179994] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a25ae988-23bf-4081-a73c-bf94ad1bd3f0: rpc.has_security_group_logging(os_id): False [ 1061.192935] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.192935] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.217022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.217022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.217022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.217022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.217022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.217022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.217022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.217022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.217022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.217022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.217022] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 is going to be created. [ 1061.276083] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.278212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.278212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.278294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.278495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.289694] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 in Status: IN_PROGRESS for 2s [ 1061.405252] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.405506] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.407756] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.407756] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.407756] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.407756] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port d82457a1-a20e-4aae-b42a-3603d54a6baf not found, creating... [ 1061.407756] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.407756] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.407756] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.408353] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.408353] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.408463] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.408663] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.409046] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.409310] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.409472] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.409658] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: d82457a1-a20e-4aae-b42a-3603d54a6baf is going to be created. [ 1061.440576] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.440838] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.440992] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.441326] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.441581] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.441844] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-d82457a1-a20e-4aae-b42a-3603d54a6baf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.524190] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521d23d6-a304-4823-bf14-9899102d1eac in Status: SUCCESS [ 1061.524190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.524319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.524755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.524755] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.524878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.524976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.525138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.525272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.525377] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.695232] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.696412] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.833632] env[69647]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1061.833632] env[69647]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1062.030575] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.128361] env[69647]: INFO networking_nsxv3.common.synchronization [req-56bb5e8c-a4a5-4081-87af-7ecbe30c39bd req-45606783-abc8-4524-99e1-ab2b863129db service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 1062.128361] env[69647]: INFO networking_nsxv3.common.synchronization [req-56bb5e8c-a4a5-4081-87af-7ecbe30c39bd req-45606783-abc8-4524-99e1-ab2b863129db service nova] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1062.128361] env[69647]: INFO networking_nsxv3.common.synchronization [req-56bb5e8c-a4a5-4081-87af-7ecbe30c39bd req-45606783-abc8-4524-99e1-ab2b863129db service nova] Enqueued Resource ID: d82457a1-a20e-4aae-b42a-3603d54a6baf with Priority: HIGHEST for action port [ 1062.128622] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_rules [ 1062.128622] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1062.128693] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d82457a1-a20e-4aae-b42a-3603d54a6baf with Priority: HIGHEST for action port [ 1062.128971] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.129171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.129239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.129459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.129543] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.130365] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.130458] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.130651] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-d82457a1-a20e-4aae-b42a-3603d54a6baf taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.130765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d82457a1-a20e-4aae-b42a-3603d54a6baf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.130849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d82457a1-a20e-4aae-b42a-3603d54a6baf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.130966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d82457a1-a20e-4aae-b42a-3603d54a6baf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.131085] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d82457a1-a20e-4aae-b42a-3603d54a6baf',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.198236] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.198410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.198459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.198674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.198768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.198857] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 is going to be updated. [ 1062.200292] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.200405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.200568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.200778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.200892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.201018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1062.237331] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.237494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.237538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.237737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.237882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.239516] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.239621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.239691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.239841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.239960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.249012] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1062.249626] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: IN_PROGRESS for 2s [ 1062.534343] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.634494] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.634733] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.634810] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d82457a1-a20e-4aae-b42a-3603d54a6baf with status ACTIVE [ 1062.634972] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.635094] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.635162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.635377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.635480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.635661] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.635756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.635814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.637261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.637261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.637261] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.637261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.637261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.637261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.637261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.637261] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d82457a1-a20e-4aae-b42a-3603d54a6baf is going to be updated. [ 1062.658370] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.658515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.658583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.658807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.659209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.659209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d82457a1-a20e-4aae-b42a-3603d54a6baf" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.771644] env[69647]: INFO networking_nsxv3.common.synchronization [req-b368870a-bcb7-4886-afaa-21c56f6cec74 req-61a44b70-b875-4605-83a9-3a39e55f8a06 tempest-ServerRescueTestJSON-99266533 tempest-ServerRescueTestJSON-99266533-project-member] Enqueued Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1062.772235] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1062.772524] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.772643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.772708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.772908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.773262] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.773385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.773450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.773596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.773697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.773781] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.010192] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 1063.010450] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 deletion is rescheduled due to dependency. [ 1063.010765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.010956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.011216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.011411] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.011532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.011638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.011752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.011832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.011927] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.037815] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.038010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.038082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.038274] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.038737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.038830] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521d23d6-a304-4823-bf14-9899102d1eac is going to be updated. [ 1063.077448] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-767 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.077671] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-767" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.077764] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-767" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.078072] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-767" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.078303] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.078516] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.078584] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.078765] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.078910] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.079233] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.079233] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.079344] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.079444] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.079549] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.079746] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.079814] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.086367] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.086478] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.086581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.086707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.086850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.096413] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521d23d6-a304-4823-bf14-9899102d1eac in Status: IN_PROGRESS for 2s [ 1063.104380] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.104563] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1063.104705] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.104878] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-767" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.105207] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-99be88dd-e9d9-4d16-a82e-13d2dc3263f0 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.105463] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-99be88dd-e9d9-4d16-a82e-13d2dc3263f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.105606] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-99be88dd-e9d9-4d16-a82e-13d2dc3263f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.105917] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-99be88dd-e9d9-4d16-a82e-13d2dc3263f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.106072] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99be88dd-e9d9-4d16-a82e-13d2dc3263f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.276251] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.306887] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 in Status: SUCCESS [ 1063.307132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.516036] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.610527] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.610527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.610527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.610527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.610527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.610527] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 99be88dd-e9d9-4d16-a82e-13d2dc3263f0 not found, creating... [ 1063.610527] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.610527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.610527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.610527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.610527] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.611255] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.611255] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.611255] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.611390] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.611482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.611624] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 99be88dd-e9d9-4d16-a82e-13d2dc3263f0 is going to be created. [ 1063.630188] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.630472] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.630665] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.631049] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.631389] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.631731] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-99be88dd-e9d9-4d16-a82e-13d2dc3263f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.779143] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.018926] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.176657] env[69647]: INFO networking_nsxv3.common.synchronization [req-d3621a59-b124-4d43-b627-84c736d9ed5e req-a0df248e-effc-4396-beee-b5b59ef549b7 tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_members [ 1064.177190] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGHEST for action security_group_members [ 1064.177502] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-6168f488-7a73-4458-9cef-b4375e37e273 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.177624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.177694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.177899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.178064] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.178167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.178229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.178383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.178467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.178622] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6168f488-7a73-4458-9cef-b4375e37e273',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.259184] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1064.259480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.259853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.260063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.260295] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.260448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.260538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.260729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.260841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.260962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.261167] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.262615] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: SUCCESS [ 1064.262826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.263012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.263266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.263439] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.263580] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.263671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.263847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.263956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.264118] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.264933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.265126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.265299] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.265403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.265463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.265603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.265680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.265760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.265845] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.270813] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.270921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.271850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.271850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.271850] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.271850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.271850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.271850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.272076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.272076] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.280931] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.280931] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.281114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.281193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.281244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.281334] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce95814a-dc89-465e-b193-75e16b57b822 is going to be updated. [ 1064.307494] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.307679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.307764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.307992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.308289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.316969] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: IN_PROGRESS for 2s [ 1064.323264] env[69647]: INFO networking_nsxv3.common.synchronization [req-b368870a-bcb7-4886-afaa-21c56f6cec74 req-de43b2cc-f2c7-49ba-b70c-320fb603d209 service nova] Enqueued Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_rules [ 1064.323264] env[69647]: INFO networking_nsxv3.common.synchronization [req-b368870a-bcb7-4886-afaa-21c56f6cec74 req-de43b2cc-f2c7-49ba-b70c-320fb603d209 service nova] Enqueued Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1064.323264] env[69647]: INFO networking_nsxv3.common.synchronization [req-b368870a-bcb7-4886-afaa-21c56f6cec74 req-de43b2cc-f2c7-49ba-b70c-320fb603d209 service nova] Enqueued Resource ID: 99be88dd-e9d9-4d16-a82e-13d2dc3263f0 with Priority: HIGHEST for action port [ 1064.323622] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_rules [ 1064.323622] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1064.323622] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99be88dd-e9d9-4d16-a82e-13d2dc3263f0 with Priority: HIGHEST for action port [ 1064.323967] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.324222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.324222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.327150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.327150] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.327150] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.327150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.327150] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-99be88dd-e9d9-4d16-a82e-13d2dc3263f0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.327150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99be88dd-e9d9-4d16-a82e-13d2dc3263f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.327150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99be88dd-e9d9-4d16-a82e-13d2dc3263f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.327150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99be88dd-e9d9-4d16-a82e-13d2dc3263f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.327150] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99be88dd-e9d9-4d16-a82e-13d2dc3263f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.522417] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.522417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.522417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.522609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.522609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.522680] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 1064.551559] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.551559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.551559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.551559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.551559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.557792] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 1064.684264] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.684595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.684595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.684745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.684837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.685074] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.685232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.685300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.685444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.685523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.685622] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6168f488-7a73-4458-9cef-b4375e37e273 is going to be updated. [ 1064.713951] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.714116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.714204] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.714433] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.714566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.722241] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6168f488-7a73-4458-9cef-b4375e37e273 in Status: IN_PROGRESS for 2s [ 1064.771595] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.774185] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.775338] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.831507] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.831627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.831834] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99be88dd-e9d9-4d16-a82e-13d2dc3263f0 with status ACTIVE [ 1064.831997] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.832113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.832176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.832372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.834031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.834031] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.834031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.834031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.834031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.834031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.834031] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.834031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.834031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.834031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.834031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.834031] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99be88dd-e9d9-4d16-a82e-13d2dc3263f0 is going to be updated. [ 1064.856956] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.856956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.856956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.856956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.856956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.856956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99be88dd-e9d9-4d16-a82e-13d2dc3263f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.106593] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521d23d6-a304-4823-bf14-9899102d1eac in Status: SUCCESS [ 1065.106811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.106985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.107236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.107435] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.107552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.107618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.107772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.107853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.107937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.108046] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.275190] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.277256] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e760e2e0-3e38-4b10-a3c7-8fe274472ed2: rpc.has_security_group_logging(os_id): False [ 1065.278313] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.294884] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.295030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.295104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.295308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.295400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.295678] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.295770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.295815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.295948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.296035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.296146] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 is going to be created. [ 1065.342335] env[69647]: INFO networking_nsxv3.common.synchronization [req-8e15e717-c9b3-46f6-939a-143f22e1a547 req-3f76b421-2616-42e5-9d1b-7e4b0986c874 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1065.342618] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1065.342940] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.343073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.343207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.343398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.343541] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.343640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.343700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.343885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.343926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.344083] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.346432] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.347102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.347102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.347102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.347102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.357540] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: IN_PROGRESS for 2s [ 1065.617152] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.741282] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.741563] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.741641] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.741913] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.742134] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.742427] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.742517] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.742948] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.743147] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.743341] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.743454] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.743908] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.744017] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.744094] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.744176] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.744301] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.762955] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.762955] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1065.763150] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.763256] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.763565] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-c8021a30-9727-4b97-90fb-987735aeba84 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.763733] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-c8021a30-9727-4b97-90fb-987735aeba84" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.763859] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-c8021a30-9727-4b97-90fb-987735aeba84" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.764243] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-c8021a30-9727-4b97-90fb-987735aeba84" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.764388] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8021a30-9727-4b97-90fb-987735aeba84',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.776698] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.776698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.776698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.776698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.777346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.777346] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1065.780221] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.780351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.780444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.780601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.780698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.780783] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 is going to be updated. [ 1065.807114] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.807114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.807114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.807114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.807114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.808675] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.808806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.809069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.809069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.809200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.818617] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: IN_PROGRESS for 2s [ 1065.819351] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1065.847804] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.113069] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 521d23d6-a304-4823-bf14-9899102d1eac: rpc.has_security_group_logging(os_id): False [ 1066.161183] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.161356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.161426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.161666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.161765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.162009] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.162116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.162179] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.162334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.162410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.162495] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521d23d6-a304-4823-bf14-9899102d1eac is going to be created. [ 1066.267521] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.267521] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.267802] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.267929] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.269030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.269030] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port c8021a30-9727-4b97-90fb-987735aeba84 not found, creating... [ 1066.269030] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.269030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.269030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.269533] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.269533] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.269533] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.269773] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.269773] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.269996] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.270160] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.270306] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: c8021a30-9727-4b97-90fb-987735aeba84 is going to be created. [ 1066.275456] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.275624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.275713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.275809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.275985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.290540] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521d23d6-a304-4823-bf14-9899102d1eac in Status: IN_PROGRESS for 2s [ 1066.298841] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.299230] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.299470] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.299904] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.300417] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.300655] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-c8021a30-9727-4b97-90fb-987735aeba84" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.330409] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: SUCCESS [ 1066.330676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.330853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.331206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.331499] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.331628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.331695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.331903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.331950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.332359] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.348113] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.566300] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 1066.566538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.566705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.566939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.567147] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.567258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.567331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.567491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.567576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.567634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.567726] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.731824] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6168f488-7a73-4458-9cef-b4375e37e273 in Status: SUCCESS [ 1066.731934] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6168f488-7a73-4458-9cef-b4375e37e273 deletion is rescheduled due to dependency. [ 1066.732034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.834975] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.853741] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.853741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.853741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.853741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.853741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.853741] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b889aaff-9fca-4d8b-92bf-300934a13f44 is going to be updated. [ 1066.880906] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.882562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.882817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.884047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.884359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.902179] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: IN_PROGRESS for 2s [ 1067.070556] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.070769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.070821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.071195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.071393] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.071569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.071687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.071828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.071951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.072086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.072291] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.072413] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.072497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.072683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.072855] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.072977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.073079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.073293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.073399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.073518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.073642] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.336720] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.369037] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: SUCCESS [ 1067.369322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.369593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.369927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.369927] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.537311] env[69647]: INFO networking_nsxv3.common.synchronization [req-8e15e717-c9b3-46f6-939a-143f22e1a547 req-e00ba647-12d1-4799-bf29-e89b7b86afd3 service nova] Enqueued Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_rules [ 1067.537311] env[69647]: INFO networking_nsxv3.common.synchronization [req-8e15e717-c9b3-46f6-939a-143f22e1a547 req-e00ba647-12d1-4799-bf29-e89b7b86afd3 service nova] Enqueued Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1067.537311] env[69647]: INFO networking_nsxv3.common.synchronization [req-8e15e717-c9b3-46f6-939a-143f22e1a547 req-e00ba647-12d1-4799-bf29-e89b7b86afd3 service nova] Enqueued Resource ID: c8021a30-9727-4b97-90fb-987735aeba84 with Priority: HIGHEST for action port [ 1067.537311] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_rules [ 1067.537311] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1067.537311] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8021a30-9727-4b97-90fb-987735aeba84 with Priority: HIGHEST for action port [ 1067.538629] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.539052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.539261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.539585] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.539945] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.541446] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.541446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.541446] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8021a30-9727-4b97-90fb-987735aeba84 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.544692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8021a30-9727-4b97-90fb-987735aeba84" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.544692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8021a30-9727-4b97-90fb-987735aeba84" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.544692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8021a30-9727-4b97-90fb-987735aeba84" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.544692] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8021a30-9727-4b97-90fb-987735aeba84',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.576049] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 326bee86-2025-4239-98be-95f9262ac7a3: rpc.has_security_group_logging(os_id): False [ 1067.593809] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.594016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.594149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.594414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.594515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.594770] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.594914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.594974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.595099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.595180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.595501] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.595606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.595606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.595742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.595816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.596025] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.596116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.596180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.596334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.596411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.596518] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 1067.649749] env[69647]: INFO networking_nsxv3.common.synchronization [req-93b0e41c-3700-4791-b0ad-249e992c3077 req-5116ab73-b7f7-4c52-81f8-3dde56d1f5ce tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1067.650298] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1067.650603] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.650726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.650803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.651060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.651210] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.651313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.651399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.651561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.651640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.651729] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.658190] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.658331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.658377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.658539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.658680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.672072] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 1067.829674] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: SUCCESS [ 1067.829945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.830139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.830376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.830576] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.830701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.830772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.830920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.831027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.831311] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.833040] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1067.833292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.833475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.833681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.833886] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.834043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.834123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.834493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.834493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.834493] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.840142] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.840142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.840142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.841583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.841583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.841583] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce95814a-dc89-465e-b193-75e16b57b822 is going to be updated. [ 1067.872531] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.872531] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.890819] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.890819] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.891011] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.891126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.891301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.900538] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: IN_PROGRESS for 2s [ 1067.972376] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.972376] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.972376] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.974180] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.974608] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.974885] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.975114] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.975494] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.975755] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.976117] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.976350] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.976565] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.976797] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.976975] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.978475] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.978672] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.001711] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.001880] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1068.002025] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.002206] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.002511] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-42e1c9dd-f934-46d2-b796-fa5826c25352 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.002688] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-42e1c9dd-f934-46d2-b796-fa5826c25352" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.002809] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-42e1c9dd-f934-46d2-b796-fa5826c25352" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.003201] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-42e1c9dd-f934-46d2-b796-fa5826c25352" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.003352] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42e1c9dd-f934-46d2-b796-fa5826c25352',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.046666] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.046748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.047399] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8021a30-9727-4b97-90fb-987735aeba84 with status ACTIVE [ 1068.047588] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.047706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.047773] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.047969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.048076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.048238] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.054787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.054787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.054787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.054787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.054787] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.054787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.054787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.054787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.054787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.054787] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8021a30-9727-4b97-90fb-987735aeba84 is going to be updated. [ 1068.079576] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.079576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.079576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.079576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.079576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.079576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8021a30-9727-4b97-90fb-987735aeba84" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.153843] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.153843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.154087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.154297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.154429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.154760] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.154760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.154903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.155073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.155183] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.155302] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b81759fd-827f-4158-bff1-7caece3251c2 already deleted. [ 1068.155475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.302518] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521d23d6-a304-4823-bf14-9899102d1eac in Status: SUCCESS [ 1068.302749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.340564] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.341557] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.506643] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.507331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.507331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.507472] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.507587] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.507749] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 42e1c9dd-f934-46d2-b796-fa5826c25352 not found, creating... [ 1068.508154] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.508370] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.508500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.508720] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.508859] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.509160] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.509317] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.509433] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.509642] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.509788] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.509925] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 42e1c9dd-f934-46d2-b796-fa5826c25352 is going to be created. [ 1068.531777] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.532022] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.532145] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.532413] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.532665] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.532966] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-42e1c9dd-f934-46d2-b796-fa5826c25352" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.843530] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.844628] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.913345] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: SUCCESS [ 1068.913551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.913673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.913946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.914197] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.914401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.914532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.914654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.914782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.914886] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.207466] env[69647]: INFO networking_nsxv3.common.synchronization [req-93b0e41c-3700-4791-b0ad-249e992c3077 req-2484bd08-5bde-4f0a-a172-d2f6e7ad536d service nova] Enqueued Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_rules [ 1069.207466] env[69647]: INFO networking_nsxv3.common.synchronization [req-93b0e41c-3700-4791-b0ad-249e992c3077 req-2484bd08-5bde-4f0a-a172-d2f6e7ad536d service nova] Enqueued Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1069.207590] env[69647]: INFO networking_nsxv3.common.synchronization [req-93b0e41c-3700-4791-b0ad-249e992c3077 req-2484bd08-5bde-4f0a-a172-d2f6e7ad536d service nova] Enqueued Resource ID: 42e1c9dd-f934-46d2-b796-fa5826c25352 with Priority: HIGHEST for action port [ 1069.209163] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_rules [ 1069.209284] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1069.209439] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42e1c9dd-f934-46d2-b796-fa5826c25352 with Priority: HIGHEST for action port [ 1069.209751] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.209917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.209988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.210251] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.210369] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.211581] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.211757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.211757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.211889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.212033] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.213253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.213375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.213547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.213634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.213737] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.214520] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-42e1c9dd-f934-46d2-b796-fa5826c25352 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.214635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42e1c9dd-f934-46d2-b796-fa5826c25352" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.214692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42e1c9dd-f934-46d2-b796-fa5826c25352" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.214841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42e1c9dd-f934-46d2-b796-fa5826c25352" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.214920] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42e1c9dd-f934-46d2-b796-fa5826c25352',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.347856] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.348540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.348540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.348666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.348701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.348779] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 is going to be updated. [ 1069.350698] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.350698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.350698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.350891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.350891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.350891] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1069.381278] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.381278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.381278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.381619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.381813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.383582] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.383704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.383765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.383956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.384093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.393647] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: IN_PROGRESS for 2s [ 1069.394553] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1069.417191] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.687443] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 1069.687693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.716435] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.716696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.716882] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.717745] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42e1c9dd-f934-46d2-b796-fa5826c25352 with status ACTIVE [ 1069.717935] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.718082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.718151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.718363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.718452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.718627] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.718797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.718797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.718920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.718993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.719484] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.719484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.719484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.719484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.719709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.719709] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42e1c9dd-f934-46d2-b796-fa5826c25352 is going to be updated. [ 1069.750089] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.750294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.750294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.750511] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.750653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.750826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42e1c9dd-f934-46d2-b796-fa5826c25352" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.909778] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: SUCCESS [ 1069.910117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.910185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.910405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.910601] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.910713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.910776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.910939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.911072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.911187] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.911286] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.920055] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.078577] env[69647]: INFO networking_nsxv3.common.synchronization [req-dc34120b-6556-44de-80c1-9ee8bf98e93d req-0a12d0cb-ed42-4cd8-8b92-aa0a41649389 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1070.079068] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1070.079426] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.079645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.223085] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.401735] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-827 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.401939] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-827" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.402264] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-827" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.402776] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-827" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.403251] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.403803] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.404030] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.404372] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.404615] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.404942] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.405143] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.405325] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.405535] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.405677] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.405917] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.406169] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.416023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.416023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.416023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.416023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.416023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.417040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.417040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.417040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.417040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.417040] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.422053] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.422865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.422865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.422865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.422865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.422865] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b889aaff-9fca-4d8b-92bf-300934a13f44 is going to be updated. [ 1070.428228] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.428228] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1070.428228] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.428228] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-827" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.428228] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-4443bdfb-b014-485a-ae32-9213988b7599 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.428228] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.428228] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.428228] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.428228] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4443bdfb-b014-485a-ae32-9213988b7599',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.448941] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.449173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.449221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.449871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.449871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.464030] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: IN_PROGRESS for 2s [ 1070.726601] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.726601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.726601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.726601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.726601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.726601] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b81759fd-827f-4158-bff1-7caece3251c2 is going to be created. [ 1070.747960] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.747960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.747960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.748292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.748328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.756842] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: UNINITIALIZED for 2s [ 1070.920039] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce95814a-dc89-465e-b193-75e16b57b822: rpc.has_security_group_logging(os_id): False [ 1070.935214] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.935466] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.935679] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.935977] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.936221] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.936422] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 4443bdfb-b014-485a-ae32-9213988b7599 not found, creating... [ 1070.936804] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.936994] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.937162] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.937429] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.937609] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.937915] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.938092] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.938213] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.938432] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.938606] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.938827] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 4443bdfb-b014-485a-ae32-9213988b7599 is going to be created. [ 1070.940619] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.940783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.940832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.940974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.941106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.941346] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.941491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.941491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.941633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.941711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.941898] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.941993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.942070] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.942276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.942331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.942514] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.942612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.942674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.942816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.942890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.942973] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce95814a-dc89-465e-b193-75e16b57b822 is going to be updated. [ 1070.968186] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.968496] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.968590] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.968891] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.969146] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.969430] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.005396] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.005654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.005719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.005949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.006109] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.021858] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: IN_PROGRESS for 2s [ 1071.403898] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1071.404127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.404339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.404584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.404817] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.404960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.405330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.405552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.405638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.405732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.405919] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.406043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.406117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.406221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.406366] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.406467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.406538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.406883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.406967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.407043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.407142] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.408724] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: SUCCESS [ 1071.408931] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.409124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.409285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.409549] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.409674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.409758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.409911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.409981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.410061] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.413973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.413973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.413973] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.413973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.413973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.413973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.413973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.413973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.413973] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.742443] env[69647]: INFO networking_nsxv3.common.synchronization [req-dc34120b-6556-44de-80c1-9ee8bf98e93d req-cb732e8a-e2fe-42b4-a305-84d79da10b65 service nova] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1071.742653] env[69647]: INFO networking_nsxv3.common.synchronization [req-dc34120b-6556-44de-80c1-9ee8bf98e93d req-cb732e8a-e2fe-42b4-a305-84d79da10b65 service nova] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1071.742844] env[69647]: INFO networking_nsxv3.common.synchronization [req-dc34120b-6556-44de-80c1-9ee8bf98e93d req-cb732e8a-e2fe-42b4-a305-84d79da10b65 service nova] Enqueued Resource ID: 4443bdfb-b014-485a-ae32-9213988b7599 with Priority: HIGHEST for action port [ 1071.745151] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1071.745361] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1071.745528] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4443bdfb-b014-485a-ae32-9213988b7599 with Priority: HIGHEST for action port [ 1071.745951] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.746911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.748252] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.748473] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.748712] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-4443bdfb-b014-485a-ae32-9213988b7599 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.748929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.748999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.749437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.749475] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4443bdfb-b014-485a-ae32-9213988b7599',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.845061] env[69647]: INFO networking_nsxv3.common.synchronization [req-8cb844d8-5217-4df9-b77c-37408d35924d req-c9c7389b-0b3c-4679-9260-c2f395af0d95 tempest-ServerRescueNegativeTestJSON-41623176 tempest-ServerRescueNegativeTestJSON-41623176-project-member] Enqueued Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_members [ 1071.845724] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff with Priority: HIGHEST for action security_group_members [ 1071.846339] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.846595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.846768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.847023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.847195] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.848517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.848517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.848976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.849092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.849192] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('deec7c2d-a3e1-4f84-97a5-b5433b7b69ff',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.914456] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d20c2212-5440-4d22-b2b5-94431ba7f51c: rpc.has_security_group_logging(os_id): False [ 1071.915249] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.918308] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.935139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.935139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.935139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.935139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.936067] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.938410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.938410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.938410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.938410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.938410] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1072.003062] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.003062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.003062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.003062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.003062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.018790] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1072.252148] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4443bdfb-b014-485a-ae32-9213988b7599 with status ACTIVE [ 1072.252399] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.252544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.252620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.252986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.253119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.253404] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.253515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.253596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.253846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.253927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.254163] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.254320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.254411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.254587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.254665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.254754] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4443bdfb-b014-485a-ae32-9213988b7599 is going to be updated. [ 1072.284637] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.284839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.284906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.285159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.285342] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.286501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.360042] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.360212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.360336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.360533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.360631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.360846] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.360949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.361027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.361173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.361269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.361367] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff is going to be updated. [ 1072.407722] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.407722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.407722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.407910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.408193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.423450] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff in Status: IN_PROGRESS for 2s [ 1072.423450] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.423450] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e760e2e0-3e38-4b10-a3c7-8fe274472ed2: rpc.has_security_group_logging(os_id): False [ 1072.446401] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.446401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.446401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.446401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.446401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.446401] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.446401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.446401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.446401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.446401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.446401] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 is going to be updated. [ 1072.471572] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: SUCCESS [ 1072.471572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.471572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.471572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.471572] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.471572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.471572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.471572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.471572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.471572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.471572] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.510859] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.511017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.511097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.511370] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.512123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.526021] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: IN_PROGRESS for 2s [ 1072.767931] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: SUCCESS [ 1072.768123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.768280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.768502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.768766] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.770701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.770701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.770701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.770701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.770701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.770919] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.925619] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.925935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.925935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.926124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.926223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.926330] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1072.957917] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.958354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.958540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.958780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.958948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.975367] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.977139] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1073.044695] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: SUCCESS [ 1073.044695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.276467] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.478068] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b889aaff-9fca-4d8b-92bf-300934a13f44: rpc.has_security_group_logging(os_id): False [ 1073.495301] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.495301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.495301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.495540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.495540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.495830] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.495935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.495991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.496160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.496236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.496325] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b889aaff-9fca-4d8b-92bf-300934a13f44 is going to be updated. [ 1073.534853] env[69647]: INFO networking_nsxv3.common.synchronization [req-a0aa5e62-557c-4921-9a23-d8ae7db1ee02 req-fd7c569a-e23b-4e40-8ac9-f704c0651741 tempest-ImagesOneServerNegativeTestJSON-126282846 tempest-ImagesOneServerNegativeTestJSON-126282846-project-member] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1073.535298] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1073.535618] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.535766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.535828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.536014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.536175] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.536275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.536332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.536480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.536562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.536653] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.552827] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.553042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.553150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.553489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.553692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.573444] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: IN_PROGRESS for 2s [ 1073.778698] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b81759fd-827f-4158-bff1-7caece3251c2: rpc.has_security_group_logging(os_id): False [ 1073.802957] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.803164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.803276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.803562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.803667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.804513] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.804513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.804513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.804513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.804513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.804513] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b81759fd-827f-4158-bff1-7caece3251c2 is going to be created. [ 1073.861023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.861186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.861260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.861585] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.861790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.875697] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: IN_PROGRESS for 2s [ 1074.032039] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1074.032357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.032498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.032762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.033048] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.039016] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.039165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.039233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.039457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.039553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.039734] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.039829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.039935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.040048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.040125] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.040211] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 is going to be updated. [ 1074.067620] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.067620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.067620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.067620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.067926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.075992] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: IN_PROGRESS for 2s [ 1074.426950] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff in Status: SUCCESS [ 1074.427232] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: deec7c2d-a3e1-4f84-97a5-b5433b7b69ff deletion is rescheduled due to dependency. [ 1074.427406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-deec7c2d-a3e1-4f84-97a5-b5433b7b69ff" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.535523] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.535841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.546569] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: SUCCESS [ 1074.546790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.986614] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1074.986841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.987035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.987265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.987453] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.987570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.987638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.987794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.987875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.987971] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.490956] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.586722] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: SUCCESS [ 1075.586996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.889709] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: SUCCESS [ 1075.889709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.994090] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.085746] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: SUCCESS [ 1076.085746] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 deletion is rescheduled due to dependency. [ 1076.085746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.382323] env[69647]: INFO networking_nsxv3.common.synchronization [None req-604f539f-e739-486e-a6de-35f7ab5a8b1f tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1076.383011] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1076.384096] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.384096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.384096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.384096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.384525] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.384607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.386304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.388288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.388511] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.392018] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.496194] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.496470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.496470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.496634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.496725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.496824] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1076.536203] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.536380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.536428] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.536632] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.536782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.549202] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1076.784149] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.784301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.784405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.784635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.785189] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.893636] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.893824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.893898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.894170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.894356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.894500] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.894621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.894684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.894864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.894953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.895076] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be updated. [ 1076.918579] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.918758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.918825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.919086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.920332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.927231] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 1077.288406] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.790613] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.293153] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1078.293269] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1078.558504] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1078.558726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.558911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.559715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.559715] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.559715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.559715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.559715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.559715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.560025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.560025] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.939470] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 1078.939749] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 deletion is rescheduled due to dependency. [ 1078.939791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.062176] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.062176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.062355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.062507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.075945] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1079.076876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.077748] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1079.078960] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.079099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.079215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.079433] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.079622] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.079752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.079857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.080033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.080154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.080265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.080434] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.080620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.080620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.080732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.080867] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.080927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.080983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.081130] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.081201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.081284] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.081401] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.116433] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.116677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.116749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.116990] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.127796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.129013] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1079.129174] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1079.129306] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1079.172332] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.172571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.172702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.173045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.175213] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.175462] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1079.260678] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.260831] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.260900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.261233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.261591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.261890] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1079.351820] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.351983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.352033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.352262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.352560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.353061] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:50. [ 1079.353183] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0fbffbeb-5173-4e7a-966f-dee89646c2c1', 'f6ff3703-4f0f-4e11-8846-e36203877107', '9da9f265-ecd5-4341-a63a-3d1380826075', 'ce95814a-dc89-465e-b193-75e16b57b822', '2c97e0fb-c576-4b45-ad7b-02877e627733', '3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda', 'b392030a-efbc-48e0-a255-c920f33d1ae4', 'ed16e80e-360a-42fc-afac-b1d84a97137e', 'd92e25ad-3d95-4a6f-bb9e-55be52df486a', 'b26cf444-4671-4a90-a2a4-c6ca9787ad9f', 'cca2232a-e86b-4244-935e-7ec99c85e7c0', '4691b465-a6c4-42d2-86ce-653d3dc9c97e', '6168f488-7a73-4458-9cef-b4375e37e273', 'a25ae988-23bf-4081-a73c-bf94ad1bd3f0', '80142545-bab7-4367-b0e0-40b8e04f4503', '521d23d6-a304-4823-bf14-9899102d1eac', 'd20c2212-5440-4d22-b2b5-94431ba7f51c', '4bf79df0-b6e9-4d9d-a118-0af87f6e322a', '34219d1a-fbd9-401c-90a3-4321fbe00e34', 'c427a432-7eaa-43a9-b426-56f256eb360c', '0c879b90-76f3-430e-8b1f-ba2fe27e511f', 'efccc372-9e22-4eea-9577-4fd80da780f3', '8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f', '90e6d13e-7877-4688-9ade-504a1a3d2a71', 'ffc805fb-8c1f-41b4-83d2-89346f31ff05', 'f5145c69-8ea2-4421-9b34-0a1bbf81d37d', 'ac810154-f096-4495-a2c8-d43e5bb3d1a2', '5bd6af1f-0d53-486d-ac51-c6ef7bb925cc', 'cd53af51-8db9-4653-95a6-3f457b519312', '11aa9110-c05f-4ee9-95eb-9ace6aec4c6a', '25192273-bc3e-4f3a-9543-1ed380b4ef9b', 'a9c01b37-5156-42f7-b415-81d83f30f935', '63aea974-cdb8-4b5a-9001-4a1c99d2d349', '9c1ac393-0d0d-48c1-adc3-b358d19ecbca', 'b889aaff-9fca-4d8b-92bf-300934a13f44', '92008a16-dbb6-4fa9-bbfd-5faf35617bb1', '690e1872-1ae4-4c49-8159-ec39c82e2868', 'dd722ad1-4b5d-44e6-b813-2502626f7fdc', 'ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190', 'e760e2e0-3e38-4b10-a3c7-8fe274472ed2', '7c35014e-8d95-4c20-872d-da537d220b20', '67fa0349-fc9a-4525-98b6-98f14f9e267b', '26d75834-c6a8-4d76-af3a-6cec3f2d79e2', 'deec7c2d-a3e1-4f84-97a5-b5433b7b69ff', '326bee86-2025-4239-98be-95f9262ac7a3', 'b81759fd-827f-4158-bff1-7caece3251c2', '27b912c1-294b-407e-bd8a-c81f04912b02', '7b0043ff-d285-4932-aeae-115f9e86d947', 'db4ef3a0-bf1a-4fa4-b038-850d2015902e', '6295f807-c8cc-45a3-b9fc-b308b1e64f78'} {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1079.353291] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1079.370875] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.371081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.371160] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.371319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.373021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.373021] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1079.373021] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1079.373021] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1079.445966] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.446156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.446306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.446467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.447628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.448103] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1079.448168] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1079.448250] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1079.448328] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1079.448387] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/50 resources of Type:Security Group Rules [ 1079.448496] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGH for action security_group_rules [ 1079.448544] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGH for action security_group_rules [ 1079.448599] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGH for action security_group_rules [ 1079.448654] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGH for action security_group_rules [ 1079.448710] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGH for action security_group_rules [ 1079.448768] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGH for action security_group_rules [ 1079.448822] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGH for action security_group_rules [ 1079.448876] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed16e80e-360a-42fc-afac-b1d84a97137e with Priority: HIGH for action security_group_rules [ 1079.448940] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGH for action security_group_rules [ 1079.449030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGH for action security_group_rules [ 1079.449080] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGH for action security_group_rules [ 1079.449455] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGH for action security_group_rules [ 1079.449455] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGH for action security_group_rules [ 1079.449455] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGH for action security_group_rules [ 1079.449455] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGH for action security_group_rules [ 1079.449455] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGH for action security_group_rules [ 1079.449455] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGH for action security_group_rules [ 1079.449455] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGH for action security_group_rules [ 1079.449830] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGH for action security_group_rules [ 1079.449830] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGH for action security_group_rules [ 1079.449830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.583880] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d20c2212-5440-4d22-b2b5-94431ba7f51c: rpc.has_security_group_logging(os_id): False [ 1079.603284] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.603486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.603543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.603731] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.621948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.622259] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.622400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.622512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.622781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.622920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.623231] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.623448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.623568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.623801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.623874] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.624137] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.624316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.624409] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.624559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.624670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.624775] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1079.679610] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.679833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.679833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.680044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.680191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.699267] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1080.682901] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec83a039-e7df-4c32-9d47-bf345d8e0c00 req-4fe4d692-e6ba-4a4b-aa9a-0962721b2b22 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1080.682901] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec83a039-e7df-4c32-9d47-bf345d8e0c00 req-4fe4d692-e6ba-4a4b-aa9a-0962721b2b22 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_members [ 1080.682901] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_members [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b392030a-efbc-48e0-a255-c920f33d1ae4 with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80142545-bab7-4367-b0e0-40b8e04f4503 with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c427a432-7eaa-43a9-b426-56f256eb360c with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6168f488-7a73-4458-9cef-b4375e37e273 with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed16e80e-360a-42fc-afac-b1d84a97137e with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGH for action security_group_rules [ 1080.688030] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGH for action security_group_rules [ 1080.690187] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.693894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.693894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.693894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.693894] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.693894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.693894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.693894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.693894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.693894] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.695211] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-81848831-127a-4805-980f-3ebb96bb19b4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.698079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.698079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.698079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.698079] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.698079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.698079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.698079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.698079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.698079] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.701312] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.701312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.701312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.701312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.701312] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fbffbeb-5173-4e7a-966f-dee89646c2c1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.703831] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.705129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.705129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.705129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.705129] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.705962] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b392030a-efbc-48e0-a255-c920f33d1ae4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.706512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.706721] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.706985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.707364] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b392030a-efbc-48e0-a255-c920f33d1ae4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.709064] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80142545-bab7-4367-b0e0-40b8e04f4503 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.709266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.709364] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.709555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.709666] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80142545-bab7-4367-b0e0-40b8e04f4503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.711165] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c427a432-7eaa-43a9-b426-56f256eb360c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.711579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.711684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.711933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.712073] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c427a432-7eaa-43a9-b426-56f256eb360c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.712975] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34219d1a-fbd9-401c-90a3-4321fbe00e34 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.713635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.713746] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.713947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.714386] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.716161] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.716312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.716633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.716837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.716950] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bf79df0-b6e9-4d9d-a118-0af87f6e322a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.717831] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.718335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.718589] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.718833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.718930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.719124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.719229] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.720056] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521d23d6-a304-4823-bf14-9899102d1eac taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.720670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.720781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.720968] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.721086] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.722259] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6168f488-7a73-4458-9cef-b4375e37e273 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.722429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.722526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.722713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.723035] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6168f488-7a73-4458-9cef-b4375e37e273',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.726133] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.726133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.726133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.726133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.726133] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4691b465-a6c4-42d2-86ce-653d3dc9c97e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.726133] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.726133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.726133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.726133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.726133] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.727735] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.727914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.731578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.731578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.731578] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b26cf444-4671-4a90-a2a4-c6ca9787ad9f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.731578] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.731578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.731578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.731578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.731578] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d92e25ad-3d95-4a6f-bb9e-55be52df486a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.731578] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.731578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.731578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.731578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.731578] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.732670] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed16e80e-360a-42fc-afac-b1d84a97137e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.732942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.733166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.733356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.733479] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed16e80e-360a-42fc-afac-b1d84a97137e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.735339] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c97e0fb-c576-4b45-ad7b-02877e627733 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.735339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.735484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.735641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.735695] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c97e0fb-c576-4b45-ad7b-02877e627733',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.737037] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6ff3703-4f0f-4e11-8846-e36203877107 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.737495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.737598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.737786] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.737995] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.739394] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.739394] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.739733] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.739770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.739861] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.745419] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec83a039-e7df-4c32-9d47-bf345d8e0c00 req-4fe4d692-e6ba-4a4b-aa9a-0962721b2b22 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_rules [ 1080.745665] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec83a039-e7df-4c32-9d47-bf345d8e0c00 req-4fe4d692-e6ba-4a4b-aa9a-0962721b2b22 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_members [ 1080.745845] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec83a039-e7df-4c32-9d47-bf345d8e0c00 req-4fe4d692-e6ba-4a4b-aa9a-0962721b2b22 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1080.746195] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec83a039-e7df-4c32-9d47-bf345d8e0c00 req-4fe4d692-e6ba-4a4b-aa9a-0962721b2b22 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1080.746390] env[69647]: INFO networking_nsxv3.common.synchronization [req-ec83a039-e7df-4c32-9d47-bf345d8e0c00 req-4fe4d692-e6ba-4a4b-aa9a-0962721b2b22 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 4443bdfb-b014-485a-ae32-9213988b7599 with Priority: HIGHEST for action port [ 1080.747557] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_rules [ 1080.747754] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1080.747893] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4443bdfb-b014-485a-ae32-9213988b7599 with Priority: HIGHEST for action port [ 1080.748062] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_members [ 1080.748137] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1080.748441] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81848831-127a-4805-980f-3ebb96bb19b4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.748571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.748744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.748902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.749024] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.750121] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.750227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.753384] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-4443bdfb-b014-485a-ae32-9213988b7599 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.753384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.753384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.753384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.753384] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4443bdfb-b014-485a-ae32-9213988b7599',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.753384] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-81848831-127a-4805-980f-3ebb96bb19b4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.753384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.753384] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.753384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.196371] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.201540] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.227811] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.227811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.227811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.227811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.231166] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.231269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.231844] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.231966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.232028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.232227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.232416] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.232553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.232553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.232633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.232719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.232798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.232887] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.236699] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.236699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.238015] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.238145] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.243923] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-521d23d6-a304-4823-bf14-9899102d1eac taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.243923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.243923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.243923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.243923] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.243923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.243923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.243923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.243923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.243923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.243923] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.245918] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-34219d1a-fbd9-401c-90a3-4321fbe00e34 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.245918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.245918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.245918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.245918] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.245918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.245918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.245918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.245918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.246350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.246350] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.247212] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6ff3703-4f0f-4e11-8846-e36203877107 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.247625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.247752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.247948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.248148] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.248280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.248363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.248865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.248865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.248865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.248865] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.254645] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.254645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.254645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.254645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.254645] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.254645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.254645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.254645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.254645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.254645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.254645] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.260455] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.260682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.262841] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.262982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.263888] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.264805] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.268683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.268683] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fbffbeb-5173-4e7a-966f-dee89646c2c1 is going to be deleted. [ 1081.268683] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.268932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.268932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.269242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.269242] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.269340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.269434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.269546] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.269625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.269708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.269790] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.270927] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-81848831-127a-4805-980f-3ebb96bb19b4 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.271082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.271539] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4443bdfb-b014-485a-ae32-9213988b7599 with status ACTIVE [ 1081.271742] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.271878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.271998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.272179] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.272291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.272483] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.272610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.272697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.272866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.272970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.273180] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.273309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.273392] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.273589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.273687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.273794] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4443bdfb-b014-485a-ae32-9213988b7599 is going to be updated. [ 1081.276173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.276173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.277377] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 521d23d6-a304-4823-bf14-9899102d1eac: rpc.has_security_group_logging(os_id): False [ 1081.282018] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34219d1a-fbd9-401c-90a3-4321fbe00e34: rpc.has_security_group_logging(os_id): False [ 1081.306925] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.307058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.310874] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.310994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.311730] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.311876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.315643] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.315924] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.317333] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.317461] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be deleted. [ 1081.318389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.318591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.320131] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.320284] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.321121] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.321225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.322373] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.323190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.323958] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.324066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.325314] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.325427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.325490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.325674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.325813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.325963] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.327084] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.327084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.351368] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.351573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.352526] env[69647]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1081.353444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.353444] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b392030a-efbc-48e0-a255-c920f33d1ae4 is going to be deleted. [ 1081.354364] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.354570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.375730] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.375852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.377033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.377193] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80142545-bab7-4367-b0e0-40b8e04f4503 is going to be deleted. [ 1081.377917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.378167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.436764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.436916] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed16e80e-360a-42fc-afac-b1d84a97137e is going to be deleted. [ 1081.437880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.438109] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.489810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.490241] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b26cf444-4671-4a90-a2a4-c6ca9787ad9f is going to be deleted. [ 1081.491337] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.491694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.543388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.543599] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4691b465-a6c4-42d2-86ce-653d3dc9c97e is going to be deleted. [ 1081.545036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.545036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.569359] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.569585] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.573838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.574082] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.574170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.574450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.574450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.574526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.574674] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521d23d6-a304-4823-bf14-9899102d1eac is going to be updated. [ 1081.575907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.575907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.577194] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.577194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.586750] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.586863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.608760] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.608853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.615988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.616130] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6168f488-7a73-4458-9cef-b4375e37e273 is going to be deleted. [ 1081.616993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.617152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.668780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.668947] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda is going to be deleted. [ 1081.669831] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.670059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.671490] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.671593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.696777] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.697131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.700252] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.706656] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.714585] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.714747] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c97e0fb-c576-4b45-ad7b-02877e627733 is going to be deleted. [ 1081.715538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.715928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.736197] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.736431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.736431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.736581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.736662] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.738927] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.738927] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.738927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.738927] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.748401] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1081.748401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.748401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.748401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.748401] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.756661] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.756661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.758585] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.763086] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.784153] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.784153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.784153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.784153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.784471] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.784471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.784471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.784598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.784637] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.785730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.785730] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.785730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.785730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.785730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.785730] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.785730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.785730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.785730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.786173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.786173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.786173] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.809890] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.810038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.814685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.814792] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c427a432-7eaa-43a9-b426-56f256eb360c is going to be deleted. [ 1081.815698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.815901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.851833] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.851926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.876596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.876778] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bf79df0-b6e9-4d9d-a118-0af87f6e322a is going to be deleted. [ 1081.877940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.878221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.910543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.910543] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d92e25ad-3d95-4a6f-bb9e-55be52df486a is going to be deleted. [ 1081.911603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.911824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.911922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.913897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fbffbeb-5173-4e7a-966f-dee89646c2c1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.913897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.913897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.913897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.913897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.913897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.913897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.913897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.913897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b392030a-efbc-48e0-a255-c920f33d1ae4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.913897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.914521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.081575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.081946] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.082085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.082182] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.082407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.082496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.082635] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 is going to be updated. [ 1082.083956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.084166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.084289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.084453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80142545-bab7-4367-b0e0-40b8e04f4503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.084808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.084999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.085164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.085335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed16e80e-360a-42fc-afac-b1d84a97137e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.086331] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.086460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.086537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.087271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.087271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.087271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c427a432-7eaa-43a9-b426-56f256eb360c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.087271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.087462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.087462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.087547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b26cf444-4671-4a90-a2a4-c6ca9787ad9f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.087672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.087884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.087975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.088144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4691b465-a6c4-42d2-86ce-653d3dc9c97e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.088883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.089139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.089298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.090413] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.090630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.090750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.090908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6168f488-7a73-4458-9cef-b4375e37e273" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.091092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.091284] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.091388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.091540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c97e0fb-c576-4b45-ad7b-02877e627733" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.091714] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.091869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.091953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.092155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d118f6d-f33e-4fd5-ad5d-3a1b1ca9ffda" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.099787] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.099926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.100071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.100282] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.100375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.100516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bf79df0-b6e9-4d9d-a118-0af87f6e322a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.108588] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521d23d6-a304-4823-bf14-9899102d1eac in Status: IN_PROGRESS for 2s [ 1082.168848] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.169074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.169074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.169285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.169376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.169502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d92e25ad-3d95-4a6f-bb9e-55be52df486a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.203174] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.203388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.203388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.203676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.203762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.203862] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1082.210338] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.210338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.210338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.210338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.210338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.210338] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81848831-127a-4805-980f-3ebb96bb19b4 is going to be created. [ 1082.219376] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.219513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.219557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.219764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.219941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.241962] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cca2232a-e86b-4244-935e-7ec99c85e7c0: rpc.has_security_group_logging(os_id): False [ 1082.249851] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.249983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.260044] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6ff3703-4f0f-4e11-8846-e36203877107: rpc.has_security_group_logging(os_id): False [ 1082.263907] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a25ae988-23bf-4081-a73c-bf94ad1bd3f0: rpc.has_security_group_logging(os_id): False [ 1082.266956] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.267102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.267233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.267368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.267521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.269164] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 in Status: IN_PROGRESS for 2s [ 1082.279697] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.279825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.279894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.280113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.284894] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.285028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.288298] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce95814a-dc89-465e-b193-75e16b57b822: rpc.has_security_group_logging(os_id): False [ 1082.290521] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81848831-127a-4805-980f-3ebb96bb19b4 in Status: UNINITIALIZED for 2s [ 1082.298669] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.298786] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.299536] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.299669] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.299740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.299942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.300115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.317761] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1082.318522] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.318627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.325292] env[69647]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1082.325772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.326013] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.326149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.326214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.326407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.326487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.326671] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.326778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.326839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.327057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.327140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.327329] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.327410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.327471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.327610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.327683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.327779] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 is going to be updated. [ 1082.328835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.328995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.364969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.365305] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.365410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.365478] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.365698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.365783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.365887] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6ff3703-4f0f-4e11-8846-e36203877107 is going to be updated. [ 1082.366919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.367104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.401121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.401464] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.401576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.401640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.401854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.401979] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.402231] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.402334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.402400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.402622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.402654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.402845] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.402928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.403052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.403136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.403211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.403315] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce95814a-dc89-465e-b193-75e16b57b822 is going to be updated. [ 1082.404380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.404541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.428908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.429337] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.429622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.429622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.429945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.430028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.430140] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 is going to be updated. [ 1082.472013] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.472553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.472553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.472553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.472739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.476418] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.476699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.476866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.477153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.477390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.491027] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6ff3703-4f0f-4e11-8846-e36203877107 in Status: IN_PROGRESS for 2s [ 1082.491027] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: IN_PROGRESS for 2s [ 1082.511901] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.512059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.512128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.512322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.514101] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.527779] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: IN_PROGRESS for 2s [ 1082.562027] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.562027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.562027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.562235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.562379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.595023] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 in Status: IN_PROGRESS for 2s [ 1083.646441] env[69647]: INFO networking_nsxv3.common.synchronization [None req-bc064dbd-4328-4adf-af32-27d22fe01917 tempest-ImagesOneServerNegativeTestJSON-126282846 tempest-ImagesOneServerNegativeTestJSON-126282846-project-member] Enqueued Resource ID: 45cc1b27-39cc-4012-9148-0ae1d8692751 with Priority: HIGHEST for action security_group_rules [ 1083.646982] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cc1b27-39cc-4012-9148-0ae1d8692751 with Priority: HIGHEST for action security_group_rules [ 1083.647297] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cc1b27-39cc-4012-9148-0ae1d8692751 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.647421] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cc1b27-39cc-4012-9148-0ae1d8692751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.647489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cc1b27-39cc-4012-9148-0ae1d8692751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.647744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cc1b27-39cc-4012-9148-0ae1d8692751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.647830] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cc1b27-39cc-4012-9148-0ae1d8692751',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.729217] env[69647]: INFO networking_nsxv3.common.synchronization [None req-5963501f-fb4d-42ab-b615-c6177f8aa01d tempest-ImagesOneServerNegativeTestJSON-126282846 tempest-ImagesOneServerNegativeTestJSON-126282846-project-member] Enqueued Resource ID: 45cc1b27-39cc-4012-9148-0ae1d8692751 with Priority: HIGHEST for action security_group_rules [ 1083.729217] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cc1b27-39cc-4012-9148-0ae1d8692751 with Priority: HIGHEST for action security_group_rules [ 1083.729217] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cc1b27-39cc-4012-9148-0ae1d8692751 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.729217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cc1b27-39cc-4012-9148-0ae1d8692751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.121458] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521d23d6-a304-4823-bf14-9899102d1eac in Status: SUCCESS [ 1084.121753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.170060] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.170218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.170272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.170590] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.170722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.170837] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cc1b27-39cc-4012-9148-0ae1d8692751 already deleted. [ 1084.171105] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cc1b27-39cc-4012-9148-0ae1d8692751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.171202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cc1b27-39cc-4012-9148-0ae1d8692751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.171415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cc1b27-39cc-4012-9148-0ae1d8692751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.171593] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cc1b27-39cc-4012-9148-0ae1d8692751',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.282619] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 in Status: SUCCESS [ 1084.282857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.298050] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81848831-127a-4805-980f-3ebb96bb19b4 in Status: SUCCESS [ 1084.298265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.298422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.298634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.298818] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.298938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.299036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.299171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.299251] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.299345] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.328704] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1084.328921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.329108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.329318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.329506] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.329660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.329727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.329897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.329978] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.330088] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.504682] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6ff3703-4f0f-4e11-8846-e36203877107 in Status: SUCCESS [ 1084.504682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.505477] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: SUCCESS [ 1084.505583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.541400] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: SUCCESS [ 1084.541701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.605087] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 in Status: SUCCESS [ 1084.605338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.691247] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.691577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.691577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.691839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.691971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.692148] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cc1b27-39cc-4012-9148-0ae1d8692751 already deleted. [ 1084.692269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cc1b27-39cc-4012-9148-0ae1d8692751" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.804085] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.831674] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.306288] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.334473] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.809148] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.809382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.809382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.809669] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.809779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.809894] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81848831-127a-4805-980f-3ebb96bb19b4 is going to be updated. [ 1085.837712] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.837712] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.837712] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.837980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.837980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.839113] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.839235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.839341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.839446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.839519] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.839611] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1085.847553] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81848831-127a-4805-980f-3ebb96bb19b4 in Status: IN_PROGRESS for 2s [ 1085.866120] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.866299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.866299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.866474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.866616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.873756] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1086.544571] env[69647]: INFO networking_nsxv3.common.synchronization [req-9f958161-e719-4a56-b1c6-0924eeab5bc8 req-a71e1766-5e84-4ab5-b28c-88e8d059122a tempest-ServerRescueNegativeTestJSON-41623176 tempest-ServerRescueNegativeTestJSON-41623176-project-member] Enqueued Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 1086.545408] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 1086.545714] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.545869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.545869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.546446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.546446] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.546446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.546446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.547612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.547612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.547612] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.050070] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.073413] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce9d5d3c-81dd-4c5f-ba94-661bd87894f1 req-7de428de-6e03-4b9b-a47f-bc4f8f0f6cf0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1087.073413] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce9d5d3c-81dd-4c5f-ba94-661bd87894f1 req-7de428de-6e03-4b9b-a47f-bc4f8f0f6cf0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_members [ 1087.074026] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce9d5d3c-81dd-4c5f-ba94-661bd87894f1 req-7de428de-6e03-4b9b-a47f-bc4f8f0f6cf0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 with Priority: HIGHEST for action security_group_members [ 1087.074135] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1087.074255] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_members [ 1087.074360] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 with Priority: HIGHEST for action security_group_members [ 1087.074827] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.074827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.075197] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-81848831-127a-4805-980f-3ebb96bb19b4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.075197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.075197] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfaf57ec-e57d-4f3d-935b-72606b735cb9 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.075340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.075340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.075581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.075733] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.075835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.075893] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.076087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.076175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.076318] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfaf57ec-e57d-4f3d-935b-72606b735cb9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce9d5d3c-81dd-4c5f-ba94-661bd87894f1 req-7de428de-6e03-4b9b-a47f-bc4f8f0f6cf0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_rules [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce9d5d3c-81dd-4c5f-ba94-661bd87894f1 req-7de428de-6e03-4b9b-a47f-bc4f8f0f6cf0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_members [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce9d5d3c-81dd-4c5f-ba94-661bd87894f1 req-7de428de-6e03-4b9b-a47f-bc4f8f0f6cf0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 with Priority: HIGHEST for action security_group_rules [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce9d5d3c-81dd-4c5f-ba94-661bd87894f1 req-7de428de-6e03-4b9b-a47f-bc4f8f0f6cf0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 with Priority: HIGHEST for action security_group_members [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce9d5d3c-81dd-4c5f-ba94-661bd87894f1 req-7de428de-6e03-4b9b-a47f-bc4f8f0f6cf0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce9d5d3c-81dd-4c5f-ba94-661bd87894f1 req-7de428de-6e03-4b9b-a47f-bc4f8f0f6cf0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [req-ce9d5d3c-81dd-4c5f-ba94-661bd87894f1 req-7de428de-6e03-4b9b-a47f-bc4f8f0f6cf0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 4443bdfb-b014-485a-ae32-9213988b7599 with Priority: HIGHEST for action port [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_rules [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 with Priority: HIGHEST for action security_group_rules [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4443bdfb-b014-485a-ae32-9213988b7599 with Priority: HIGHEST for action port [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_rules [ 1087.125040] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_members [ 1087.125859] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 with Priority: HIGHEST for action security_group_members [ 1087.126273] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81848831-127a-4805-980f-3ebb96bb19b4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.126514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.127067] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bfaf57ec-e57d-4f3d-935b-72606b735cb9 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.127308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.127460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.127781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.127963] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bfaf57ec-e57d-4f3d-935b-72606b735cb9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.130096] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.130096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.130096] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-4443bdfb-b014-485a-ae32-9213988b7599 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.130096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.130096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.130096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.130096] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4443bdfb-b014-485a-ae32-9213988b7599',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.130621] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.130935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.131225] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-81848831-127a-4805-980f-3ebb96bb19b4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.131420] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.131688] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfaf57ec-e57d-4f3d-935b-72606b735cb9 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.131878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.552137] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.578445] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bfaf57ec-e57d-4f3d-935b-72606b735cb9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.634597] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfaf57ec-e57d-4f3d-935b-72606b735cb9 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.634864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.635045] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4443bdfb-b014-485a-ae32-9213988b7599 with status ACTIVE [ 1087.635189] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.635299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.635359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.635658] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.635787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.636136] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.636265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.636330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.636544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.636630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.636821] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.636922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.636984] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.637145] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.637219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.637304] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4443bdfb-b014-485a-ae32-9213988b7599 is going to be updated. [ 1087.657786] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.658014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.658014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.658322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.658442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.658606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4443bdfb-b014-485a-ae32-9213988b7599" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.857341] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81848831-127a-4805-980f-3ebb96bb19b4 in Status: SUCCESS [ 1087.857341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.857463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.857612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.857803] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.857915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.858046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.858150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.858233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.858318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.858418] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.859233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.859426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.859575] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.859670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.859729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.859861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.859931] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.860022] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.881007] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1087.881212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.881360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.881556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.881762] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.881880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.881946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.882139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.882232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.882346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.882445] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.883740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.883740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.883740] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.883740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.883962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.883962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.884043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.884076] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.054883] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.055217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.055217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.055325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.055411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.055508] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 is going to be updated. [ 1088.080307] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bfaf57ec-e57d-4f3d-935b-72606b735cb9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.089422] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.089549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.089616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.089881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.090051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.106755] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: IN_PROGRESS for 2s [ 1088.361621] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.362667] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.386042] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.386042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.386042] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.582813] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.583110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.583187] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.583417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.583507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.583681] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 is going to be created. [ 1088.608346] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.608497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.608552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.608762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.608925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.617554] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 in Status: UNINITIALIZED for 2s [ 1088.620038] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.620304] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.620500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.620889] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.621361] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.621609] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.621801] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.622242] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.622436] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.622687] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.622826] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.622926] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.623068] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.623206] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.623318] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.623454] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.640300] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.640470] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1088.640615] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.640796] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.641316] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-961f86d2-2b43-48c8-9220-e01b440d9d97 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.641316] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.641604] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.641893] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.642140] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('961f86d2-2b43-48c8-9220-e01b440d9d97',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.864856] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81848831-127a-4805-980f-3ebb96bb19b4: rpc.has_security_group_logging(os_id): False [ 1088.866061] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.883285] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.883447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.883447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.883742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.883787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.884020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.884134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.884187] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.884964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.884964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.884964] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81848831-127a-4805-980f-3ebb96bb19b4 is going to be created. [ 1088.887723] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.946231] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.946415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.946465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.946647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.946822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.956832] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81848831-127a-4805-980f-3ebb96bb19b4 in Status: IN_PROGRESS for 2s [ 1089.146365] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.146365] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.146365] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.146365] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.146859] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.146859] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 961f86d2-2b43-48c8-9220-e01b440d9d97 not found, creating... [ 1089.147770] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.148058] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.148281] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.148683] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.148933] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.149406] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.149638] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.149867] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.150184] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.150400] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.150622] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 961f86d2-2b43-48c8-9220-e01b440d9d97 is going to be created. [ 1089.177711] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.177973] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.178087] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.178360] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.178607] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.178871] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.326364] env[69647]: INFO networking_nsxv3.common.synchronization [req-230d667a-3cb7-4cfd-90bd-f08603be1b13 req-76397fd5-6ec3-464b-9cb3-9e4118a8367b tempest-ImagesOneServerNegativeTestJSON-126282846 tempest-ImagesOneServerNegativeTestJSON-126282846-project-member] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1089.326604] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1089.326900] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.327378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.327517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.327682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.327832] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.327932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.327993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.328149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.328229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.328320] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.371163] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.371163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.371163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.371163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.371163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.371163] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81848831-127a-4805-980f-3ebb96bb19b4 is going to be updated. [ 1089.389985] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.390149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.390221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.390434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.390527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.390624] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1089.394462] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.394753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.394753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.394928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.394966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.403299] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81848831-127a-4805-980f-3ebb96bb19b4 in Status: IN_PROGRESS for 2s [ 1089.418864] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.418864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.418864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.419046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.419195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.428054] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1089.725065] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.725471] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.725544] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.725861] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.726199] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.726453] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.726533] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.726764] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.726913] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.727220] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.727395] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.727455] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.727556] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.727668] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.727776] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.727911] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.745379] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.745379] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1089.745530] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.745706] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.746952] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.746952] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.746952] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.746952] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.746952] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.832253] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.832431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.832505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.832766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.853173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.853428] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.853547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.853677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.854042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.854042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.854112] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 is going to be updated. [ 1089.857688] env[69647]: INFO networking_nsxv3.common.synchronization [req-b338a79a-d75d-4681-9c77-3930e6b4b575 req-9dc40fcb-78d8-40f3-82c3-d138f5a14398 service nova] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_rules [ 1089.857917] env[69647]: INFO networking_nsxv3.common.synchronization [req-b338a79a-d75d-4681-9c77-3930e6b4b575 req-9dc40fcb-78d8-40f3-82c3-d138f5a14398 service nova] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1089.858132] env[69647]: INFO networking_nsxv3.common.synchronization [req-b338a79a-d75d-4681-9c77-3930e6b4b575 req-9dc40fcb-78d8-40f3-82c3-d138f5a14398 service nova] Enqueued Resource ID: 961f86d2-2b43-48c8-9220-e01b440d9d97 with Priority: HIGHEST for action port [ 1089.858814] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_rules [ 1089.859075] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1089.859218] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961f86d2-2b43-48c8-9220-e01b440d9d97 with Priority: HIGHEST for action port [ 1089.859512] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.859668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.859757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.859956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.860084] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.860911] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.861075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.861171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.861834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.861834] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.861834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.861834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.861834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.862084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.862120] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.862875] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-961f86d2-2b43-48c8-9220-e01b440d9d97 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.863027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.863126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.863302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.863406] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('961f86d2-2b43-48c8-9220-e01b440d9d97',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.893862] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.894043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.894121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.894306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.894470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.903675] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: IN_PROGRESS for 2s [ 1090.115264] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: SUCCESS [ 1090.115477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.223463] env[69647]: INFO networking_nsxv3.common.synchronization [req-5cc51c67-078b-43db-869b-5dfd6e63149d req-9b90153e-4a8c-4f77-bc69-f5ede292acb0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 with Priority: HIGHEST for action security_group_members [ 1090.223789] env[69647]: INFO networking_nsxv3.common.synchronization [req-5cc51c67-078b-43db-869b-5dfd6e63149d req-9b90153e-4a8c-4f77-bc69-f5ede292acb0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_members [ 1090.223836] env[69647]: INFO networking_nsxv3.common.synchronization [req-5cc51c67-078b-43db-869b-5dfd6e63149d req-9b90153e-4a8c-4f77-bc69-f5ede292acb0 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1090.224707] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 with Priority: HIGHEST for action security_group_members [ 1090.224855] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81848831-127a-4805-980f-3ebb96bb19b4 with Priority: HIGHEST for action security_group_members [ 1090.224953] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1090.225250] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfaf57ec-e57d-4f3d-935b-72606b735cb9 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.225349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.225525] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-81848831-127a-4805-980f-3ebb96bb19b4 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.225608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.225774] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.225941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.249289] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.250022] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.250022] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.250022] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.250199] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.250274] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56 not found, creating... [ 1090.250566] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.250706] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.250867] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.251079] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.251248] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.251548] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.251829] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.251829] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.252042] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.252184] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.252343] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56 is going to be created. [ 1090.271750] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.271969] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.272107] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.272421] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.272674] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.272914] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.365363] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.365579] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.365681] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.366596] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 961f86d2-2b43-48c8-9220-e01b440d9d97 with status ACTIVE [ 1090.366775] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.366892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.366957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.367189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.367277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.367445] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.367540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.367609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.367747] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.367827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.368601] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.368774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.368848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.369016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.369100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.369194] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 961f86d2-2b43-48c8-9220-e01b440d9d97 is going to be updated. [ 1090.397157] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.397307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.397925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.397925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.397925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.397925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.627292] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 in Status: SUCCESS [ 1090.627456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.627623] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.627835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.628035] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.628156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.628225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.628384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.628467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.628563] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfaf57ec-e57d-4f3d-935b-72606b735cb9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.871930] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.971566] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81848831-127a-4805-980f-3ebb96bb19b4 in Status: SUCCESS [ 1090.971616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.971915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.972571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.972660] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.976445] env[69647]: INFO networking_nsxv3.common.synchronization [req-230d667a-3cb7-4cfd-90bd-f08603be1b13 req-d28713c2-80eb-4614-a12e-c90d47a17f07 service nova] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_rules [ 1090.976445] env[69647]: INFO networking_nsxv3.common.synchronization [req-230d667a-3cb7-4cfd-90bd-f08603be1b13 req-d28713c2-80eb-4614-a12e-c90d47a17f07 service nova] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1090.976445] env[69647]: INFO networking_nsxv3.common.synchronization [req-230d667a-3cb7-4cfd-90bd-f08603be1b13 req-d28713c2-80eb-4614-a12e-c90d47a17f07 service nova] Enqueued Resource ID: 12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56 with Priority: HIGHEST for action port [ 1090.977743] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_rules [ 1090.977939] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1090.978076] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56 with Priority: HIGHEST for action port [ 1090.978484] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.978617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.978686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.978873] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.978962] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.979735] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.979851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.980012] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.981214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.981325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.981613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.981680] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.130724] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.130890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.130933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.131176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.131278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.131473] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.131592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.131654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.131993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.132097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.132190] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 is going to be deleted. [ 1091.161009] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.161161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.161229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.161424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.161570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.161681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.161825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.161983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.162154] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.162261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.162322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.162460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.162536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.162626] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfaf57ec-e57d-4f3d-935b-72606b735cb9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.373697] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.374050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.374050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.374162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.374250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.374350] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be updated. [ 1091.400336] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.400485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.400543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.400747] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.400897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.413013] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 1091.414464] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81848831-127a-4805-980f-3ebb96bb19b4 in Status: SUCCESS [ 1091.414740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.414919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.415179] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.415369] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.415541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.415541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.415692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.415775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.415866] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.438215] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1091.438477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.438670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.438942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.439191] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.439352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.439441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.439664] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.440904] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.440904] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.482921] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.483057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.483258] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56 with status ACTIVE [ 1091.483429] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.483536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.483600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.483834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.483928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.484107] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.484202] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.484260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.484439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.484522] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.484718] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.484829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.484892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.485046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.485121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.485205] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56 is going to be updated. [ 1091.500580] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.500739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.500789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.500979] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.501634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.501634] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81848831-127a-4805-980f-3ebb96bb19b4 is going to be deleted. [ 1091.528337] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.528526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.528615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.528840] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.529015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.529204] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12b4a5cf-e62e-4495-82a3-1ec6d4fc2b56" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.538839] env[69647]: INFO networking_nsxv3.common.synchronization [req-3b95aa1d-a039-401e-ae42-582b826c8496 req-edb06c8a-0f57-491b-ad98-08fe760fef01 tempest-ServerRescueTestJSON-99266533 tempest-ServerRescueTestJSON-99266533-project-member] Enqueued Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1091.539099] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1091.542021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.542021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.542021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.542021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.542021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.542021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.542021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.542021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.542021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.542021] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.574633] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.575069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.575069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.575069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.575367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.575367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.666671] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.666671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.666671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.666671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.666671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.666671] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.667152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.667152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.667152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.667152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.667152] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 already deleted. [ 1091.667152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.667368] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bfaf57ec-e57d-4f3d-935b-72606b735cb9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.668600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.668704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.668782] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.668881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.668944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.669138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.669212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.669275] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfaf57ec-e57d-4f3d-935b-72606b735cb9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.912472] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: SUCCESS [ 1091.912472] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 deletion is rescheduled due to dependency. [ 1091.912472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.912617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.912824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.912998] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.913316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.913316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.913401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.913450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.913531] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.921023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.921023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.921023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.921023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.921023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.921023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.921023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.921023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.921023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.921023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.921023] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81848831-127a-4805-980f-3ebb96bb19b4 is going to be deleted. [ 1091.942508] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.945555] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.945689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.945789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.946218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.946218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.946218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.946403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.946403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.946557] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.946657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.946751] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.946853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.946928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.947162] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81848831-127a-4805-980f-3ebb96bb19b4',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.043334] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.170622] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bfaf57ec-e57d-4f3d-935b-72606b735cb9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.172008] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.172198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.172298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.172522] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.172611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.172805] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.172900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.172952] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.173113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.173188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.173273] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 already deleted. [ 1092.173354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.420835] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.444245] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.453019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.453019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.453019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.453019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.453019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.453019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.453019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.453019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.453019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.453019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.453019] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81848831-127a-4805-980f-3ebb96bb19b4 already deleted. [ 1092.453019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81848831-127a-4805-980f-3ebb96bb19b4" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.545735] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.675325] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bfaf57ec-e57d-4f3d-935b-72606b735cb9: rpc.has_security_group_logging(os_id): False [ 1092.693234] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.693343] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.693468] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.693724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.693835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.694200] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.694335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.694523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.694722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.694866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.695045] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 is going to be created. [ 1092.711422] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/bfaf57ec-e57d-4f3d-935b-72606b735cb9], does not exist path=[/infra/domains/default/groups/bfaf57ec-e57d-4f3d-935b-72606b735cb9]."\n}' [ 1092.711637] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bfaf57ec-e57d-4f3d-935b-72606b735cb9 [ 1092.711771] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1092.754165] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.754165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.754165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.754165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.755293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.755734] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.755907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.756037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.756339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.756445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.756756] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.756890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.756975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.757187] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.757288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.757402] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfaf57ec-e57d-4f3d-935b-72606b735cb9 is going to be created. [ 1092.774741] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/bfaf57ec-e57d-4f3d-935b-72606b735cb9], does not exist path=[/infra/domains/default/groups/bfaf57ec-e57d-4f3d-935b-72606b735cb9]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bfaf57ec-e57d-4f3d-935b-72606b735cb9 [ 1092.774998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bfaf57ec-e57d-4f3d-935b-72606b735cb9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.775166] env[69647]: Traceback (most recent call last): [ 1092.775227] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1092.775227] env[69647]: return func(*args, **kwargs) [ 1092.775227] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1092.775227] env[69647]: res.raise_for_status() [ 1092.775227] env[69647]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1092.775227] env[69647]: raise HTTPError(http_error_msg, response=self) [ 1092.775227] env[69647]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bfaf57ec-e57d-4f3d-935b-72606b735cb9 [ 1092.775227] env[69647]: During handling of the above exception, another exception occurred: [ 1092.775227] env[69647]: Traceback (most recent call last): [ 1092.775227] env[69647]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1092.775227] env[69647]: listener.cb(fileno) [ 1092.775227] env[69647]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1092.775227] env[69647]: result = function(*args, **kwargs) [ 1092.775227] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1092.775227] env[69647]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1092.775227] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1092.775227] env[69647]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1092.775227] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1092.775227] env[69647]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1092.775227] env[69647]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1092.775227] env[69647]: res.raise_for_status() [ 1092.775227] env[69647]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1092.775227] env[69647]: raise HTTPError(http_error_msg, response=self) [ 1092.775227] env[69647]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bfaf57ec-e57d-4f3d-935b-72606b735cb9 [ 1092.775227] env[69647]: Removing descriptor: 73 [ 1092.875196] env[69647]: INFO networking_nsxv3.common.synchronization [req-a8628fad-2e4a-4cdf-aab5-e0e5602f47a8 req-37bdf817-f0d1-4d12-8857-cfe1673785bf tempest-AttachVolumeTestJSON-1527312667 tempest-AttachVolumeTestJSON-1527312667-project-member] Enqueued Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_members [ 1092.875891] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGHEST for action security_group_members [ 1092.876400] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-34219d1a-fbd9-401c-90a3-4321fbe00e34 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.876617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.876737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.876991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.877212] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.877345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.879873] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.880172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.880306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.880424] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.924830] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.946921] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.947188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.947295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.947536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.947627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.950992] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1092.973744] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.973953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.974046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.974213] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.974427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.982490] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1093.047763] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.048022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.048099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.048368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.048490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.048636] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce95814a-dc89-465e-b193-75e16b57b822 is going to be updated. [ 1093.105212] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.105407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.105495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.105759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.105957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.115661] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: IN_PROGRESS for 2s [ 1093.382416] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.382587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.382633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.382867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.404095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.404363] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.404485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.404548] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.404825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.404899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.404993] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 is going to be updated. [ 1093.420053] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 1093.420372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.420583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.420843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.421108] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.421227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.421330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.421533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.421762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.421901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.422043] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.427126] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.427260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.427328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.427497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.427578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.427666] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 is going to be updated. [ 1093.429430] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.429534] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.429605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.429762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.429891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.440958] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 in Status: IN_PROGRESS for 2s [ 1093.453637] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.453637] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.453789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.453990] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.454213] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.462783] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: IN_PROGRESS for 2s [ 1093.943966] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.992668] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.992668] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.992668] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.992668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.993413] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.993413] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.139667] env[69647]: INFO networking_nsxv3.common.synchronization [req-ef0c09dc-fcb7-4075-95fa-09b8ef09e00f req-dffefe8a-3192-432c-9c29-00a773e9944a tempest-ServerRescueNegativeTestJSON-41623176 tempest-ServerRescueNegativeTestJSON-41623176-project-member] Enqueued Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 1094.140267] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGHEST for action security_group_members [ 1094.140926] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.141087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.141148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.141336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.141495] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.142265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.142265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.142265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.142265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.142265] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.449418] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9da9f265-ecd5-4341-a63a-3d1380826075: rpc.has_security_group_logging(os_id): False [ 1094.466814] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.466959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.467044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.467291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.467352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.467587] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.467697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.467763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.468072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.468158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.468348] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.468444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.468507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.468651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.468726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.468913] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.469125] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.469211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.469361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.469437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.469681] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be created. [ 1094.522109] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.522257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.522592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.522592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.522740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.536647] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 1094.644667] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.644667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.644667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.644971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.672241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.672529] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.672662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.672732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.672991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.673105] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.673216] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 is going to be updated. [ 1094.708212] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.708448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.708448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.708653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.708806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.717927] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: IN_PROGRESS for 2s [ 1094.994997] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1094.995237] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.995391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.995602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.995793] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.995908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.995973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.996178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.996263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.996347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.996510] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.996592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.996654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.996795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.996934] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.997129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.997129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.997273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.997313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.997387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.997471] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.002258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.002427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.002581] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.002684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.002741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.002884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.002960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.003061] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.126935] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: IN_PROGRESS for 4s [ 1095.450687] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 in Status: SUCCESS [ 1095.451014] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 deletion is rescheduled due to dependency. [ 1095.451014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.469607] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: SUCCESS [ 1095.469831] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.470045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.470252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.470456] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.470608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.470709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.470929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.470986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.471047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.471150] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.509147] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d20c2212-5440-4d22-b2b5-94431ba7f51c: rpc.has_security_group_logging(os_id): False [ 1095.510241] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.526903] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.527134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.527207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.527529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.546411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.546820] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.546975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.547112] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.547442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.547603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.547954] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.548149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.548267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.548524] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.548669] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.548972] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.549171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.549277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.549525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.549673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.549824] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1095.608696] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.608696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.608696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.608696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.608696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.626873] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1095.973563] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.973764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.973861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.974153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.974383] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.974518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.974610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.974830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.974945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.975072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.975266] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.975390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.975474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.975763] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.975833] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.975946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.976050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.976228] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.976326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.976432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.976549] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.012739] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.479041] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b0043ff-d285-4932-aeae-115f9e86d947: rpc.has_security_group_logging(os_id): False [ 1096.497190] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.497373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.497443] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.497683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.516956] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.517196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.517267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.517429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.517538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.517626] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1096.519414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.519616] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.519733] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.519800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.519974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.520808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.520808] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.520808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.520808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.520808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.520808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.521037] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.521100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.521207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.521312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.521387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.521472] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 is going to be updated. [ 1096.553537] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.553711] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.553839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.554018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.554181] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.555707] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 1096.555907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.564734] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1096.580630] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.580780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.580881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.581139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.581271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.591674] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: IN_PROGRESS for 2s [ 1096.727790] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 in Status: SUCCESS [ 1096.727962] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 deletion is rescheduled due to dependency. [ 1096.728085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.134968] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: SUCCESS [ 1097.135211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.641068] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1097.641465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.641526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.641691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.641874] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.144743] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.144920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.575099] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1098.575357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.575462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.575737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.576019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.576149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.576262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.576448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.576554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.576663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.576777] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.601849] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: SUCCESS [ 1098.602087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.079562] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.079834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.079873] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.080232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.080420] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.080599] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.080649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.080847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.080988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.081112] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.081313] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.081419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.081510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.081661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.081821] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.081925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.082015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.082172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.082366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.082504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.082610] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.141126] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1099.141332] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1099.584829] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d20c2212-5440-4d22-b2b5-94431ba7f51c: rpc.has_security_group_logging(os_id): False [ 1099.603408] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.603408] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.603408] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.603589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.603818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.603918] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.604010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.604081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.604248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.604382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.604546] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.604649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.604805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.604843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.604967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.605175] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.605270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.605369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.605517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.605591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.605677] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1099.670282] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.670478] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.670584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.670877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.671109] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.714475] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1099.941589] env[69647]: INFO networking_nsxv3.common.synchronization [req-f2d24f51-cdd3-486e-a3ee-dfea763e25fd req-62c052d3-e655-4f8e-98cc-24aa06fd0e00 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1099.941799] env[69647]: INFO networking_nsxv3.common.synchronization [req-f2d24f51-cdd3-486e-a3ee-dfea763e25fd req-62c052d3-e655-4f8e-98cc-24aa06fd0e00 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_members [ 1099.941966] env[69647]: INFO networking_nsxv3.common.synchronization [req-f2d24f51-cdd3-486e-a3ee-dfea763e25fd req-62c052d3-e655-4f8e-98cc-24aa06fd0e00 tempest-SecurityGroupsTestJSON-425145146 tempest-SecurityGroupsTestJSON-425145146-project-member] Enqueued Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGHEST for action security_group_members [ 1099.944739] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d20c2212-5440-4d22-b2b5-94431ba7f51c with Priority: HIGHEST for action security_group_members [ 1099.944932] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 with Priority: HIGHEST for action security_group_members [ 1099.945047] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGHEST for action security_group_members [ 1099.945285] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-d20c2212-5440-4d22-b2b5-94431ba7f51c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.945408] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.945470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.945767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.945959] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.946116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.946167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.946310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.946394] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.946489] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.947754] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.947872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.947918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.948095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.948236] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.948336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.948402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.948516] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.948591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.948700] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e760e2e0-3e38-4b10-a3c7-8fe274472ed2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.949627] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-521d23d6-a304-4823-bf14-9899102d1eac taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.949726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.949800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.949987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.951275] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.951522] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.951628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.951798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.951988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.952098] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.002073] env[69647]: INFO networking_nsxv3.common.synchronization [req-b55092cc-9f11-4bc6-b80c-b1b3d7952648 req-f6108ddf-a54f-4abb-a253-895bb22da0b9 tempest-ServerRescueTestJSON-99266533 tempest-ServerRescueTestJSON-99266533-project-member] Enqueued Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1100.002647] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGHEST for action security_group_members [ 1100.003011] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.003154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.003227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.003457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.003645] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.003794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.003893] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.004089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.004231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.004342] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.454046] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.454406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.454406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.454498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.454582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.454780] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.454909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.454983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.455192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.455278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.455369] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be updated. [ 1100.456494] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.456604] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.456672] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.456825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.458142] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.458239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.482425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.482581] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.482696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.482748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.482936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.483033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.483118] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 is going to be updated. [ 1100.484212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.484424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.499191] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.499318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.499391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.499601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.499753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.503368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.503502] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.503581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.503619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.504010] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.504164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.504322] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521d23d6-a304-4823-bf14-9899102d1eac is going to be updated. [ 1100.506818] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.507571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.507571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.507571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.512611] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: IN_PROGRESS for 2s [ 1100.514907] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.515042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.515104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.515286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.515536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.523360] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: IN_PROGRESS for 2s [ 1100.533690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.533999] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.534163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.534232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.534430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.534512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.534602] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce95814a-dc89-465e-b193-75e16b57b822 is going to be updated. [ 1100.536932] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.537066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.537111] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.537306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.537441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.558847] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521d23d6-a304-4823-bf14-9899102d1eac in Status: IN_PROGRESS for 2s [ 1100.590137] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.590298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.590417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.590571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.590828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.602432] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: IN_PROGRESS for 2s [ 1101.732705] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1101.733016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.733167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.733389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.733530] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.254315] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.254470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.254537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.254745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.254848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.254933] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c is going to be deleted. [ 1102.299377] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.299520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.299615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.299799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.299891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.300068] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.300185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.300335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.300849] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d20c2212-5440-4d22-b2b5-94431ba7f51c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.521052] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d20c2212-5440-4d22-b2b5-94431ba7f51c in Status: SUCCESS [ 1102.522026] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c deletion is rescheduled due to dependency. [ 1102.522026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.531167] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 in Status: SUCCESS [ 1102.531609] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e760e2e0-3e38-4b10-a3c7-8fe274472ed2 deletion is rescheduled due to dependency. [ 1102.531609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e760e2e0-3e38-4b10-a3c7-8fe274472ed2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.568336] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521d23d6-a304-4823-bf14-9899102d1eac in Status: SUCCESS [ 1102.568738] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521d23d6-a304-4823-bf14-9899102d1eac deletion is rescheduled due to dependency. [ 1102.568738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.610676] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce95814a-dc89-465e-b193-75e16b57b822 in Status: SUCCESS [ 1102.610921] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce95814a-dc89-465e-b193-75e16b57b822 deletion is rescheduled due to dependency. [ 1102.610974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.819478] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.819784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.819784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.819914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.819997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.820115] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d20c2212-5440-4d22-b2b5-94431ba7f51c already deleted. [ 1102.820203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d20c2212-5440-4d22-b2b5-94431ba7f51c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.003612] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1105.003612] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1105.941463] env[69647]: INFO networking_nsxv3.common.synchronization [req-82fe73a1-04a9-4ce1-8650-0cbd5faf2d4b req-50419f6f-b44d-4af8-a6ce-f61d663a5fc0 tempest-DeleteServersTestJSON-2018617287 tempest-DeleteServersTestJSON-2018617287-project-member] Enqueued Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1105.942033] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326bee86-2025-4239-98be-95f9262ac7a3 with Priority: HIGHEST for action security_group_members [ 1105.942216] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-326bee86-2025-4239-98be-95f9262ac7a3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.942353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.942431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.942625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.943859] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.943859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.943859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.943859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.943859] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.943859] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('326bee86-2025-4239-98be-95f9262ac7a3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.446211] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.446718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.446718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.446718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.468401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.468675] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.468797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.468868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.469104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.469194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.469289] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 is going to be updated. [ 1106.493962] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.494213] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.494285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.494460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.494617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.502575] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: IN_PROGRESS for 2s [ 1107.725178] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-357 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.725178] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.725178] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.725178] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.725178] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.725941] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.726214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.726585] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.726843] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.727222] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.727456] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.727657] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.727849] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.728176] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.728400] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.728628] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.750311] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.750311] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1107.750311] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.750311] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-357" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.750311] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-961f86d2-2b43-48c8-9220-e01b440d9d97 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.750311] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.750311] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.750311] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.750311] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('961f86d2-2b43-48c8-9220-e01b440d9d97',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.253203] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.253497] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.253634] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.254023] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.254208] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.254509] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.254669] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.254871] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.255103] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.255257] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.255551] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.255710] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.255830] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.256058] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.256198] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.256350] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 961f86d2-2b43-48c8-9220-e01b440d9d97 is going to be updated. [ 1108.280602] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.280867] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.281028] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.281347] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.281573] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.281836] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.514245] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 326bee86-2025-4239-98be-95f9262ac7a3 in Status: SUCCESS [ 1108.514623] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 326bee86-2025-4239-98be-95f9262ac7a3 deletion is rescheduled due to dependency. [ 1108.514623] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-326bee86-2025-4239-98be-95f9262ac7a3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.013013] env[69647]: INFO networking_nsxv3.common.synchronization [req-de502adc-43d6-4b1e-8eac-02519c6319e4 req-7058697e-cf44-40c7-95ae-621856877782 service nova] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_rules [ 1109.013446] env[69647]: INFO networking_nsxv3.common.synchronization [req-de502adc-43d6-4b1e-8eac-02519c6319e4 req-7058697e-cf44-40c7-95ae-621856877782 service nova] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1109.013446] env[69647]: INFO networking_nsxv3.common.synchronization [req-de502adc-43d6-4b1e-8eac-02519c6319e4 req-7058697e-cf44-40c7-95ae-621856877782 service nova] Enqueued Resource ID: 961f86d2-2b43-48c8-9220-e01b440d9d97 with Priority: HIGHEST for action port [ 1109.013534] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_rules [ 1109.013578] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1109.014714] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961f86d2-2b43-48c8-9220-e01b440d9d97 with Priority: HIGHEST for action port [ 1109.014714] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.014714] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.014714] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.015072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.015072] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.015801] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.015871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.015913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.016214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.016214] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.016386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.016386] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.016476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.016943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.016943] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.017622] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-961f86d2-2b43-48c8-9220-e01b440d9d97 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.017622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.017767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.017860] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.017945] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('961f86d2-2b43-48c8-9220-e01b440d9d97',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.520012] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.520133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.520364] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.521357] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 961f86d2-2b43-48c8-9220-e01b440d9d97 with status ACTIVE [ 1109.521437] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.521536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.521601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.521871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.521928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.522121] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.522222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.522283] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.522439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.522540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.522739] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.522798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.522836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.522963] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.523093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.523131] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 961f86d2-2b43-48c8-9220-e01b440d9d97 is going to be updated. [ 1109.543391] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.544417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.544417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.544417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.544576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.544701] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-961f86d2-2b43-48c8-9220-e01b440d9d97" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.024776] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.527440] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.527569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.527569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.527846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.527915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.528030] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be updated. [ 1110.554908] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.555171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.555171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.555333] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.555484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.563306] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 1111.318326] env[69647]: INFO networking_nsxv3.common.synchronization [req-9cb4929a-75e5-46ca-80e3-cf33c75dd479 req-4a5f104d-0a0a-4698-8119-ba2d8b5366c4 tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1111.319318] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1111.319660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.319811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.319894] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.320127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.320453] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.320589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.320686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.320866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.320969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.321989] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.825323] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.825539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.825676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.826499] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.855853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.856077] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.856244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.856273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.856458] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.856540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.856628] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be updated. [ 1111.881233] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.881404] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.881489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.881806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.882032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.891026] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: IN_PROGRESS for 2s [ 1112.574196] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 1112.574196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.574196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.574196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.574196] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.574196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.574196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.574196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.574196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.574196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.574196] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.967427] env[69647]: INFO networking_nsxv3.common.synchronization [req-6b00e917-6e39-4e7f-96a2-b59987b7c2f1 req-f8f2c82d-8a88-46a0-a945-55131871396e tempest-ImagesOneServerNegativeTestJSON-126282846 tempest-ImagesOneServerNegativeTestJSON-126282846-project-member] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1112.970363] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1112.970887] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.971418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.971630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.972085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.972373] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.972534] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.972676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.973138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.973320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.973519] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.077121] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.077121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.077121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.077121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.077301] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.077352] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.077377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.077524] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.077612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.077708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.077855] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.078075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.078075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.078181] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.078356] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.078422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.078448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.078571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.078644] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.078724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.078812] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.523313] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.523313] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.523313] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 is going to be updated. [ 1113.523313] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.523313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.525457] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: IN_PROGRESS for 2s [ 1113.583205] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9da9f265-ecd5-4341-a63a-3d1380826075: rpc.has_security_group_logging(os_id): False [ 1113.604878] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.605028] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.605101] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.605310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.605782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.605782] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.605782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.605782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.605927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.605951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.606936] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.606936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.606936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.606936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.606936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.607626] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.607626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.607626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.607626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.607626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.608865] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be updated. [ 1113.683130] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.683389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.683441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.683674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.683849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.705603] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 1113.900443] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: SUCCESS [ 1113.900443] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 deletion is rescheduled due to dependency. [ 1113.900443] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.521352] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: SUCCESS [ 1115.521618] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 deletion is rescheduled due to dependency. [ 1115.521698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.721452] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 1115.721708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.971607] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1117.971895] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1119.095333] env[69647]: INFO networking_nsxv3.common.synchronization [req-21758d23-3016-43dc-b5e0-b1e9a18b9464 req-7e90caf5-6a35-4e38-9246-e642638fa5e7 tempest-ServerActionsTestOtherB-626642147 tempest-ServerActionsTestOtherB-626642147-project-member] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1119.095639] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1119.096327] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.096327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.096327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.096327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.096512] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.096597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.096642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.096767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.096845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.096941] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.598745] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.598899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.598899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.599152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.621825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.621825] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.621825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.621825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.621825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.621825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.621825] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be updated. [ 1119.647861] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.647861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.647861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.647861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.647861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.654024] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 1121.672700] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 1121.672700] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 deletion is rescheduled due to dependency. [ 1121.672700] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.830321] env[69647]: INFO networking_nsxv3.common.synchronization [req-36d4a44a-61f3-4fa8-8472-fda62b347846 req-3cd6a456-9d7a-44d5-ae99-3486b457caba tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_members [ 1121.830855] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGHEST for action security_group_members [ 1121.831186] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.831312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.831372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.831649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.831764] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.831864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.831919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.832200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.832200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.832365] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.334403] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.334403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.334403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.334653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.353486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.353739] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.353876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.353925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.354131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.354226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.354335] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 is going to be updated. [ 1122.378591] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.378740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.378810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.379031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.379172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.392434] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 in Status: IN_PROGRESS for 2s [ 1124.403388] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 in Status: SUCCESS [ 1124.403632] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 deletion is rescheduled due to dependency. [ 1124.403720] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.683010] env[69647]: INFO networking_nsxv3.common.synchronization [req-145bf8f8-646d-4063-b17d-5cd518df96d9 req-51f4e638-fc72-432d-b09c-8c88a1212a25 tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1124.683545] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1124.683858] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.683989] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.684067] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.684345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.684499] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.684619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.684666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.684812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.684895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.684988] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.019122] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.019389] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.019557] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.019896] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.020237] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.020458] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.020617] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.020875] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.021071] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.021329] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.021482] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.021626] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.021766] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.021912] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.022063] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.022278] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.040020] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.040199] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1125.040341] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.040509] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.040795] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-31b25f16-ede6-4851-be30-ae017c561b11 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.040958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-31b25f16-ede6-4851-be30-ae017c561b11" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.041101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-31b25f16-ede6-4851-be30-ae017c561b11" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.041464] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-31b25f16-ede6-4851-be30-ae017c561b11" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.041609] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b25f16-ede6-4851-be30-ae017c561b11',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.187114] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.187295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.187295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.187498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.187558] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.187736] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.187838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.187883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.188042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.188123] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.188210] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc already deleted. [ 1125.188291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.547290] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.547870] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.547870] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.547870] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.548024] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.548142] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 31b25f16-ede6-4851-be30-ae017c561b11 not found, creating... [ 1125.550025] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.550025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.550025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.550025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.550025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.550025] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.550025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.550025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.550025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.550025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.550655] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 31b25f16-ede6-4851-be30-ae017c561b11 is going to be created. [ 1125.572680] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.572820] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.573101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.573263] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.573500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.573822] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-31b25f16-ede6-4851-be30-ae017c561b11" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.788309] env[69647]: INFO networking_nsxv3.common.synchronization [req-b606ffb3-2aa0-42f5-8a2e-573d0be8dc45 req-f771778e-96a7-446f-a242-8c16cef85f10 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1125.788792] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1125.789225] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.789404] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.789466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.789670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.789863] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.789967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.790047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.790209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.790294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.790410] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.292087] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.323953] env[69647]: INFO networking_nsxv3.common.synchronization [req-145bf8f8-646d-4063-b17d-5cd518df96d9 req-4a358081-754a-498a-af3e-202e0a100282 service nova] Enqueued Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_rules [ 1126.324153] env[69647]: INFO networking_nsxv3.common.synchronization [req-145bf8f8-646d-4063-b17d-5cd518df96d9 req-4a358081-754a-498a-af3e-202e0a100282 service nova] Enqueued Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1126.324345] env[69647]: INFO networking_nsxv3.common.synchronization [req-145bf8f8-646d-4063-b17d-5cd518df96d9 req-4a358081-754a-498a-af3e-202e0a100282 service nova] Enqueued Resource ID: 31b25f16-ede6-4851-be30-ae017c561b11 with Priority: HIGHEST for action port [ 1126.324598] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_rules [ 1126.324730] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1126.324826] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31b25f16-ede6-4851-be30-ae017c561b11 with Priority: HIGHEST for action port [ 1126.325378] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.325515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.325630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.325839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.325919] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.326701] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.326812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.326878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.327050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.327194] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.327288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.327351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.327488] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.327569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.327655] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.328352] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-31b25f16-ede6-4851-be30-ae017c561b11 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.328462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31b25f16-ede6-4851-be30-ae017c561b11" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.328520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31b25f16-ede6-4851-be30-ae017c561b11" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.328665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31b25f16-ede6-4851-be30-ae017c561b11" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.328736] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31b25f16-ede6-4851-be30-ae017c561b11',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.794399] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.830713] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.831792] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.831792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.833212] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31b25f16-ede6-4851-be30-ae017c561b11 with status ACTIVE [ 1126.833584] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.833584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.833584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.833734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.833826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.833987] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.834094] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.834158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.834354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.834432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.834650] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.834743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.834799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.834937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.835017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.835104] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31b25f16-ede6-4851-be30-ae017c561b11 is going to be updated. [ 1126.854431] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.854561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.854648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.854792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.854921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.855086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31b25f16-ede6-4851-be30-ae017c561b11" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.926467] env[69647]: INFO networking_nsxv3.common.synchronization [req-d1dfdafb-46a0-4f66-abb1-13ae877e4ba2 req-dd9caaf3-d7f3-495d-bc04-6a7e44d7099c tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1126.927067] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1126.927384] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.927508] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.927571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.927999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.927999] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.927999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.928138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.928212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.930074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.930074] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.297218] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.297391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.297460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.297656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.297748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.297845] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b889aaff-9fca-4d8b-92bf-300934a13f44 is going to be updated. [ 1127.333123] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.333276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.333419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.333532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.333681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.336938] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.357503] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: IN_PROGRESS for 2s [ 1127.434137] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.434137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.434137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.434137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.434137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.434137] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.434137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.434137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.434137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.434137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.434695] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be updated. [ 1127.463018] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.463018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.463018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.463018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.463018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.473899] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: IN_PROGRESS for 2s [ 1127.509071] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.509377] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.509427] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.509662] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.509912] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.510083] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.510202] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.510428] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.510572] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.510784] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.510897] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.511014] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.511130] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.511243] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.511350] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.511484] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.532755] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.532923] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.533078] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.533260] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.533596] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-f5c9c724-59d5-4624-9292-63f607b52c14 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.533870] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-f5c9c724-59d5-4624-9292-63f607b52c14" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.533947] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-f5c9c724-59d5-4624-9292-63f607b52c14" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.534239] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-f5c9c724-59d5-4624-9292-63f607b52c14" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.534471] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5c9c724-59d5-4624-9292-63f607b52c14',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.839766] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.840050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.840050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.840344] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.840445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.840549] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc is going to be created. [ 1127.863725] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.863884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.863955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.864162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.864341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.881046] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: UNINITIALIZED for 2s [ 1128.036647] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.036874] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.037012] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.037318] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.037468] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.037627] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port f5c9c724-59d5-4624-9292-63f607b52c14 not found, creating... [ 1128.037896] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.038070] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.038193] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.038409] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.038548] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.038829] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.038986] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.039120] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.039331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.039469] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.039622] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: f5c9c724-59d5-4624-9292-63f607b52c14 is going to be created. [ 1128.058802] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.059074] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.059147] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.059400] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.059626] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.059847] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-f5c9c724-59d5-4624-9292-63f607b52c14" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.824920] env[69647]: INFO networking_nsxv3.common.synchronization [req-d1dfdafb-46a0-4f66-abb1-13ae877e4ba2 req-5e2565b5-38fd-49a5-868c-38d9069bc029 service nova] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_rules [ 1128.825343] env[69647]: INFO networking_nsxv3.common.synchronization [req-d1dfdafb-46a0-4f66-abb1-13ae877e4ba2 req-5e2565b5-38fd-49a5-868c-38d9069bc029 service nova] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1128.825748] env[69647]: INFO networking_nsxv3.common.synchronization [req-d1dfdafb-46a0-4f66-abb1-13ae877e4ba2 req-5e2565b5-38fd-49a5-868c-38d9069bc029 service nova] Enqueued Resource ID: f5c9c724-59d5-4624-9292-63f607b52c14 with Priority: HIGHEST for action port [ 1128.826419] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_rules [ 1128.826676] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1128.826878] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5c9c724-59d5-4624-9292-63f607b52c14 with Priority: HIGHEST for action port [ 1128.827339] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.827580] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.827721] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.828111] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.828266] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.829579] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.829774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.830083] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5c9c724-59d5-4624-9292-63f607b52c14 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.830376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5c9c724-59d5-4624-9292-63f607b52c14" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.830520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5c9c724-59d5-4624-9292-63f607b52c14" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.830982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5c9c724-59d5-4624-9292-63f607b52c14" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.831613] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5c9c724-59d5-4624-9292-63f607b52c14',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.333367] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.333749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.333749] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5c9c724-59d5-4624-9292-63f607b52c14 with status ACTIVE [ 1129.333816] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.333907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.333970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.334201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.334336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.334513] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.334612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.334685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.334823] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.334899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.335094] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.335187] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.335249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.335493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.335594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.335681] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5c9c724-59d5-4624-9292-63f607b52c14 is going to be updated. [ 1129.358371] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.358479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.358549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.358705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.358828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.358965] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5c9c724-59d5-4624-9292-63f607b52c14" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.368550] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: SUCCESS [ 1129.368735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.484149] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: SUCCESS [ 1129.484239] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 deletion is rescheduled due to dependency. [ 1129.484327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.485116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.485116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.485116] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.485116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.485116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.485351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.485351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.485351] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.681781] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-152 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.681958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.682107] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.682519] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.682849] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.682965] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.683098] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.683322] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.683481] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.683682] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.683797] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.683938] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.684084] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.684184] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.684509] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.684509] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.701722] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.701867] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1129.702013] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.702184] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-152" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.702464] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-c1b4c161-88ce-4712-ab0f-d84411f44d32 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.702624] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.702743] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.702967] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.703119] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1b4c161-88ce-4712-ab0f-d84411f44d32',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.889950] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: SUCCESS [ 1129.890376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.890550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.890760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.890955] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.891085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.891155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.891312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.891397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.891527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.891637] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.989008] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.205035] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.205334] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.205412] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.205686] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.205841] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.206153] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.206319] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.206442] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.206721] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.206814] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.207115] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.207275] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.207394] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.207604] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.207739] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.207884] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: c1b4c161-88ce-4712-ab0f-d84411f44d32 is going to be updated. [ 1130.230178] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.230367] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.230484] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.230719] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.230908] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.231133] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.394561] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.394978] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.394978] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.395130] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.395209] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.395324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.395528] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.395806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.395934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.396088] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.396291] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.396429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.396503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.396699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.396854] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.396962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.397728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.397728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.397728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.397728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.397728] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.492400] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.900307] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab38e957-a1f6-4899-8baa-e3b1e3516ffc: rpc.has_security_group_logging(os_id): False [ 1130.921789] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.921789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.921789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.921789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.921789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.922113] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.922113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.922113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.922327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.922414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.922689] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.922771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.922799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.922940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.923018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.923253] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.923350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.923409] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.923624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.923624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.923741] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc is going to be created. [ 1130.932849] env[69647]: INFO networking_nsxv3.common.synchronization [req-c5583b8a-d8f3-44ba-8d8f-137aa36dcb4c req-dc377a61-e57b-4305-b25a-0b40c3bf939b service nova] Enqueued Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_rules [ 1130.933038] env[69647]: INFO networking_nsxv3.common.synchronization [req-c5583b8a-d8f3-44ba-8d8f-137aa36dcb4c req-dc377a61-e57b-4305-b25a-0b40c3bf939b service nova] Enqueued Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_members [ 1130.933186] env[69647]: INFO networking_nsxv3.common.synchronization [req-c5583b8a-d8f3-44ba-8d8f-137aa36dcb4c req-dc377a61-e57b-4305-b25a-0b40c3bf939b service nova] Enqueued Resource ID: c1b4c161-88ce-4712-ab0f-d84411f44d32 with Priority: HIGHEST for action port [ 1130.933421] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_rules [ 1130.933550] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_members [ 1130.933646] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b4c161-88ce-4712-ab0f-d84411f44d32 with Priority: HIGHEST for action port [ 1130.934212] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.934426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.934426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.934641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.934727] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.935760] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.935760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.935854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.937271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.937271] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.937271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.937271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.937271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.937271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.937271] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.937686] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1b4c161-88ce-4712-ab0f-d84411f44d32 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.937686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.937686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.937826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.938203] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1b4c161-88ce-4712-ab0f-d84411f44d32',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.981153] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.981332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.981409] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.981616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.981794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.991563] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: IN_PROGRESS for 2s [ 1130.994512] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.994643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.994710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.994917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.995014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.995114] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be updated. [ 1131.023643] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.023797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.023845] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.024086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.024237] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.034595] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: IN_PROGRESS for 2s [ 1131.439317] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.439703] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.440740] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.441700] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1b4c161-88ce-4712-ab0f-d84411f44d32 with status ACTIVE [ 1131.441892] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.442021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.442085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.442318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.442417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.442591] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.442689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.443359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.443359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.443359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.443359] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.443359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.443539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.444250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.444250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.444250] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1b4c161-88ce-4712-ab0f-d84411f44d32 is going to be updated. [ 1131.464744] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.464907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.464947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.465169] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.465305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.465467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1b4c161-88ce-4712-ab0f-d84411f44d32" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.946556] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.451461] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.451827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.451827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.451886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.451985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.452071] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 is going to be updated. [ 1132.480337] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.480622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.480744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.481056] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.481273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.490630] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 in Status: IN_PROGRESS for 2s [ 1133.003856] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: SUCCESS [ 1133.004134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.043406] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: SUCCESS [ 1133.043635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.043780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.044133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.044994] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.044994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.044994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.044994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.044994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.044994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.044994] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.547237] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.049452] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efccc372-9e22-4eea-9577-4fd80da780f3: rpc.has_security_group_logging(os_id): False [ 1134.066554] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.066554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.066691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.066883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.066985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.067246] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.067364] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.067436] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.067598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.067695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.067788] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be updated. [ 1134.198861] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.198861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.198861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.199311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.199379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.211043] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: IN_PROGRESS for 2s [ 1134.368376] env[69647]: INFO networking_nsxv3.common.synchronization [None req-df60de2b-df39-4720-9ad5-b77199ca9ba0 tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_rules [ 1134.368799] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_rules [ 1134.369494] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.369659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.369736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.370015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.370103] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d692f86-e9ca-4af4-a87e-f20b0b67b76d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.454018] env[69647]: INFO networking_nsxv3.common.synchronization [None req-40214d6b-a66a-4c37-ac87-8e9470867be5 tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_rules [ 1134.454018] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_rules [ 1134.454335] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.454423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.499790] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 in Status: SUCCESS [ 1134.500012] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.500178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.500959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.500959] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.500959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.500959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.500959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.500959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.501317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.501317] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.889246] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.889657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.889657] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.889735] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.889779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.889919] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d already deleted. [ 1134.890042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.890665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.890665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.890665] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d692f86-e9ca-4af4-a87e-f20b0b67b76d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.003061] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.410082] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.410082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.410082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.410329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.410449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.410523] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d already deleted. [ 1135.410602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.505743] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190: rpc.has_security_group_logging(os_id): False [ 1135.522165] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.522366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.522366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.522654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.540008] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.540406] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.540532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.540602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.540802] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.540884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.540976] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 is going to be updated. [ 1135.591649] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.591870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.591923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.592175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.592323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.602748] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 in Status: IN_PROGRESS for 2s [ 1136.081986] env[69647]: INFO networking_nsxv3.common.synchronization [req-b391e28e-5529-4a28-ba73-043411e91612 req-43f573c9-8639-4548-aedc-a9f2302db521 tempest-ImagesOneServerNegativeTestJSON-126282846 tempest-ImagesOneServerNegativeTestJSON-126282846-project-member] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1136.082609] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1136.082976] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.083457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.083560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.083748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.083924] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.084037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.084099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.084285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.084378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.084490] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.223878] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: SUCCESS [ 1136.223878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.360588] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.360824] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.360957] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.361253] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.361519] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.361732] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.361891] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.362133] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.362288] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.362523] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.362656] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.362771] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.362883] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.362999] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1136.363124] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.363264] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.387580] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.387580] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1136.387580] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.387580] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-835" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.387580] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-22362102-1276-407d-b65b-9304459bf538 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.387580] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-22362102-1276-407d-b65b-9304459bf538" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.387580] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-22362102-1276-407d-b65b-9304459bf538" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.387580] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-22362102-1276-407d-b65b-9304459bf538" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.387580] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22362102-1276-407d-b65b-9304459bf538',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.586492] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.586663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.586756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.587095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.587200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.587460] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.587582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.587648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.587805] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.587876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.587965] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 is going to be updated. [ 1136.615061] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.615292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.615292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.615514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.615668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.624882] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: IN_PROGRESS for 2s [ 1136.891984] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.891984] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.891984] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.892393] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.892613] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.892790] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 22362102-1276-407d-b65b-9304459bf538 not found, creating... [ 1136.893085] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.893249] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.893370] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.893597] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.893743] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.894040] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.894203] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.894324] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.894696] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.894881] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.895058] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 22362102-1276-407d-b65b-9304459bf538 is going to be created. [ 1136.913866] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.914106] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.914237] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.914578] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.914828] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.915074] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-22362102-1276-407d-b65b-9304459bf538" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.616672] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 in Status: SUCCESS [ 1137.617084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.630880] env[69647]: INFO networking_nsxv3.common.synchronization [req-b391e28e-5529-4a28-ba73-043411e91612 req-d60b4a39-b4c1-4ef6-aa03-908bfe364948 service nova] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_rules [ 1137.630880] env[69647]: INFO networking_nsxv3.common.synchronization [req-b391e28e-5529-4a28-ba73-043411e91612 req-d60b4a39-b4c1-4ef6-aa03-908bfe364948 service nova] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1137.630880] env[69647]: INFO networking_nsxv3.common.synchronization [req-b391e28e-5529-4a28-ba73-043411e91612 req-d60b4a39-b4c1-4ef6-aa03-908bfe364948 service nova] Enqueued Resource ID: 22362102-1276-407d-b65b-9304459bf538 with Priority: HIGHEST for action port [ 1137.630880] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_rules [ 1137.630880] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1137.630880] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22362102-1276-407d-b65b-9304459bf538 with Priority: HIGHEST for action port [ 1137.631481] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.631656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.631752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.632052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.632173] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.633141] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.633244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.633437] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-22362102-1276-407d-b65b-9304459bf538 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.633540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22362102-1276-407d-b65b-9304459bf538" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.633687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22362102-1276-407d-b65b-9304459bf538" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.633983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22362102-1276-407d-b65b-9304459bf538" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.633983] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22362102-1276-407d-b65b-9304459bf538',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.135445] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.135710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.135975] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22362102-1276-407d-b65b-9304459bf538 with status ACTIVE [ 1138.136262] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.136398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.136466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.136858] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.137022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.137348] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.137530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.137588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.137810] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.137938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.138225] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.138385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.138498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.138715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.138840] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.138977] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22362102-1276-407d-b65b-9304459bf538 is going to be updated. [ 1138.172350] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.172605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.172689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.172921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.173099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.173319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22362102-1276-407d-b65b-9304459bf538" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.383141] env[69647]: INFO networking_nsxv3.common.synchronization [req-6d541423-f03b-47a0-84ca-2dc20edb3365 req-af74d292-6d5e-4b34-9cb2-4818c8c26fc2 tempest-ListServerFiltersTestJSON-8610940 tempest-ListServerFiltersTestJSON-8610940-project-member] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1138.383553] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1138.383924] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.384196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.384265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.384554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.384770] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.384880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.384944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.385133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.385218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.385312] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.635360] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: SUCCESS [ 1138.635360] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 deletion is rescheduled due to dependency. [ 1138.635360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.635726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.635726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.635840] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.636068] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.636068] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.636177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.636239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.636308] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.716317] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.716317] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.716317] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.716577] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.717060] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.717226] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.717343] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.717575] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.717716] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.717923] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.720019] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.720019] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.720019] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.720019] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.720019] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.720019] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.736354] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.736519] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1138.736660] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.736825] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.737143] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-8512a6a4-40a1-4e42-8191-e48348a34c91 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.737311] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-8512a6a4-40a1-4e42-8191-e48348a34c91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.737432] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-8512a6a4-40a1-4e42-8191-e48348a34c91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.737728] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-8512a6a4-40a1-4e42-8191-e48348a34c91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.737869] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8512a6a4-40a1-4e42-8191-e48348a34c91',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.888241] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.888241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.888241] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.888417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.888507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.888702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.888800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.888863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.889022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.889099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.889185] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e already deleted. [ 1138.889265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.141684] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.243517] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.243753] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.243887] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.244203] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.244359] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.244580] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 8512a6a4-40a1-4e42-8191-e48348a34c91 not found, creating... [ 1139.244876] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.245058] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.245182] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.245408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.245619] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.246027] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.246209] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.246335] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.246559] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.246703] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.246912] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 8512a6a4-40a1-4e42-8191-e48348a34c91 is going to be created. [ 1139.266120] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.266258] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.266316] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.266521] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.266771] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.267232] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-8512a6a4-40a1-4e42-8191-e48348a34c91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.645050] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.012190] env[69647]: INFO networking_nsxv3.common.synchronization [req-6d541423-f03b-47a0-84ca-2dc20edb3365 req-99626c65-7ec3-402e-8bdf-5abde147efd7 service nova] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_rules [ 1140.012190] env[69647]: INFO networking_nsxv3.common.synchronization [req-6d541423-f03b-47a0-84ca-2dc20edb3365 req-99626c65-7ec3-402e-8bdf-5abde147efd7 service nova] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1140.012190] env[69647]: INFO networking_nsxv3.common.synchronization [req-6d541423-f03b-47a0-84ca-2dc20edb3365 req-99626c65-7ec3-402e-8bdf-5abde147efd7 service nova] Enqueued Resource ID: 8512a6a4-40a1-4e42-8191-e48348a34c91 with Priority: HIGHEST for action port [ 1140.012190] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_rules [ 1140.012190] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1140.012190] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8512a6a4-40a1-4e42-8191-e48348a34c91 with Priority: HIGHEST for action port [ 1140.012190] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.012190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.012190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.012693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.016021] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.016021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.016021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.016021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.016021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.016021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.016021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.016021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.016021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.016021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.016021] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.016021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-8512a6a4-40a1-4e42-8191-e48348a34c91 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.016021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8512a6a4-40a1-4e42-8191-e48348a34c91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.016021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8512a6a4-40a1-4e42-8191-e48348a34c91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.016021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8512a6a4-40a1-4e42-8191-e48348a34c91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.016021] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8512a6a4-40a1-4e42-8191-e48348a34c91',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.147846] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.148090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.148164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.148388] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.148479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.148640] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 is going to be updated. [ 1140.177955] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.178154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.178154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.178385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.178541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.186423] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: IN_PROGRESS for 2s [ 1140.628853] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.628970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.629164] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.630102] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8512a6a4-40a1-4e42-8191-e48348a34c91 with status ACTIVE [ 1140.630282] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.630450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.630519] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.630728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.630814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.630984] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.631089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.631154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.631303] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.631398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.631620] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.631715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.631789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.631912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.631980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.632076] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8512a6a4-40a1-4e42-8191-e48348a34c91 is going to be updated. [ 1140.651664] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.652015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.652015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.652253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.652399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.652560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8512a6a4-40a1-4e42-8191-e48348a34c91" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.731123] env[69647]: INFO networking_nsxv3.common.synchronization [req-d4b46dc3-c4a4-4321-bd38-67b6393aea78 req-9b5936c5-01b1-4494-9cf1-adc46c6e657d tempest-ListServerFiltersTestJSON-8610940 tempest-ListServerFiltersTestJSON-8610940-project-member] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1140.731776] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1140.732145] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.732258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.006299] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.006544] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.006693] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.006993] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.007345] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.007495] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.007635] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.007880] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.008063] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.008452] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.008452] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.008561] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.008697] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.008846] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.008971] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.009155] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.028545] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.028783] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1141.028934] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.029151] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.029482] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-3b7c445b-192d-46b8-b4b8-32e7c64086d9 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.029715] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-3b7c445b-192d-46b8-b4b8-32e7c64086d9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.029789] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-3b7c445b-192d-46b8-b4b8-32e7c64086d9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.030236] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-3b7c445b-192d-46b8-b4b8-32e7c64086d9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.030426] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b7c445b-192d-46b8-b4b8-32e7c64086d9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.135695] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.534117] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.534301] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.534338] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.534864] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.535061] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.535263] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 3b7c445b-192d-46b8-b4b8-32e7c64086d9 not found, creating... [ 1141.535646] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.535820] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.535950] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.536470] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.536702] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.537395] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.537640] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.537833] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.538143] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.538337] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.538530] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 3b7c445b-192d-46b8-b4b8-32e7c64086d9 is going to be created. [ 1141.559015] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.559269] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.559935] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.559935] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.560064] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.560332] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-3b7c445b-192d-46b8-b4b8-32e7c64086d9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.637827] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.638125] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.638125] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.638387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.638562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.638624] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be created. [ 1141.677239] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.677723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.677723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.677723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.677812] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.694094] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: UNINITIALIZED for 2s [ 1142.200660] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: SUCCESS [ 1142.200868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.201043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.201258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.201445] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.202013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.202013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.202013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.202013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.202013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.202013] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.239616] env[69647]: INFO networking_nsxv3.common.synchronization [req-d4b46dc3-c4a4-4321-bd38-67b6393aea78 req-578f3627-e42c-410d-84ab-fb85fbcd2a0b service nova] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_rules [ 1142.239616] env[69647]: INFO networking_nsxv3.common.synchronization [req-d4b46dc3-c4a4-4321-bd38-67b6393aea78 req-578f3627-e42c-410d-84ab-fb85fbcd2a0b service nova] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1142.239616] env[69647]: INFO networking_nsxv3.common.synchronization [req-d4b46dc3-c4a4-4321-bd38-67b6393aea78 req-578f3627-e42c-410d-84ab-fb85fbcd2a0b service nova] Enqueued Resource ID: 3b7c445b-192d-46b8-b4b8-32e7c64086d9 with Priority: HIGHEST for action port [ 1142.239616] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_rules [ 1142.239616] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1142.239616] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b7c445b-192d-46b8-b4b8-32e7c64086d9 with Priority: HIGHEST for action port [ 1142.240259] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.240395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.240632] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.240777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.240988] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b7c445b-192d-46b8-b4b8-32e7c64086d9 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.241168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b7c445b-192d-46b8-b4b8-32e7c64086d9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.241233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b7c445b-192d-46b8-b4b8-32e7c64086d9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.241466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b7c445b-192d-46b8-b4b8-32e7c64086d9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.241599] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b7c445b-192d-46b8-b4b8-32e7c64086d9',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.704819] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.705188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.705188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.705491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.705731] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.705871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.705957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.706174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.706287] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.706399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.706602] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.706770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.706843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.706991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.707207] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.707322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.707399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.707564] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.707629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.707716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.707801] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.743762] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b7c445b-192d-46b8-b4b8-32e7c64086d9 with status ACTIVE [ 1142.743974] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.744115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.744180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.744369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.744453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.744676] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.744776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.744857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.745044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.745128] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.745325] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.745411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.745469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.745605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.745698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.745788] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b7c445b-192d-46b8-b4b8-32e7c64086d9 is going to be updated. [ 1142.766621] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.766764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.766821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.767191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.767345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.767515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b7c445b-192d-46b8-b4b8-32e7c64086d9" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.031800] env[69647]: INFO networking_nsxv3.common.synchronization [req-f12ed48d-62aa-469e-a1b8-6318db73875a req-895309e2-a790-4328-8111-cf71edad4a4e tempest-ListServerFiltersTestJSON-8610940 tempest-ListServerFiltersTestJSON-8610940-project-member] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1143.032335] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1143.032701] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.032824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.210102] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b0043ff-d285-4932-aeae-115f9e86d947: rpc.has_security_group_logging(os_id): False [ 1143.239754] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.243279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.243279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.243503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.243598] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.243825] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.243937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.243988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.244209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.244259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.244459] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.244560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.244634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.244777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.244849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.245127] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.245253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.245335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.245495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.245593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.245715] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 is going to be updated. [ 1143.332353] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.332566] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.332695] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.332977] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.333259] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.333414] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.333534] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.333761] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.333898] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.334206] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.334355] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.334498] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.334662] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.334771] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.334903] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.335121] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.337076] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.337205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.337272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.337433] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.337632] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.354849] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: IN_PROGRESS for 2s [ 1143.377955] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.378138] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1143.378275] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.378447] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-735" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.378758] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-51d66057-fab4-4026-a132-454b631a43d8 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.378935] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-51d66057-fab4-4026-a132-454b631a43d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.379069] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-51d66057-fab4-4026-a132-454b631a43d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.379387] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-51d66057-fab4-4026-a132-454b631a43d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.379521] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51d66057-fab4-4026-a132-454b631a43d8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.703107] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: SUCCESS [ 1143.703370] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.703570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.703835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.704075] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.704207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.704290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.704486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.704596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.704684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.704818] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.705783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.706027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.706123] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.706226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.706294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.706458] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.706567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.706639] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.883618] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.883948] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.884152] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.884606] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.884849] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.885138] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 51d66057-fab4-4026-a132-454b631a43d8 not found, creating... [ 1143.885463] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.885637] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.885772] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.886013] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.886170] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.886468] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.886626] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.886747] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.886958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.887108] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.887251] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 51d66057-fab4-4026-a132-454b631a43d8 is going to be created. [ 1143.907403] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.907590] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.907722] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.907958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.908214] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.908443] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-51d66057-fab4-4026-a132-454b631a43d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.208605] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.208605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.208605] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.712819] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.717040] env[69647]: INFO networking_nsxv3.common.synchronization [req-f12ed48d-62aa-469e-a1b8-6318db73875a req-c0c1dea5-7db7-4938-8fd3-9d207804ec23 service nova] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_rules [ 1144.717040] env[69647]: INFO networking_nsxv3.common.synchronization [req-f12ed48d-62aa-469e-a1b8-6318db73875a req-c0c1dea5-7db7-4938-8fd3-9d207804ec23 service nova] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1144.717040] env[69647]: INFO networking_nsxv3.common.synchronization [req-f12ed48d-62aa-469e-a1b8-6318db73875a req-c0c1dea5-7db7-4938-8fd3-9d207804ec23 service nova] Enqueued Resource ID: 51d66057-fab4-4026-a132-454b631a43d8 with Priority: HIGHEST for action port [ 1144.717040] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_rules [ 1144.717040] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1144.717040] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d66057-fab4-4026-a132-454b631a43d8 with Priority: HIGHEST for action port [ 1144.717366] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.717417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.717708] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.717708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.717837] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-51d66057-fab4-4026-a132-454b631a43d8 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.717935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51d66057-fab4-4026-a132-454b631a43d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.717997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51d66057-fab4-4026-a132-454b631a43d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.718204] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51d66057-fab4-4026-a132-454b631a43d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.718280] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51d66057-fab4-4026-a132-454b631a43d8',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.216820] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.217036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.217116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.217360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.217461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.217565] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be updated. [ 1145.220334] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51d66057-fab4-4026-a132-454b631a43d8 with status ACTIVE [ 1145.220522] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.220643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.220690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.220851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.220930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.221106] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.221201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.221261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.221399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.221473] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.221666] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.221767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.221828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.221967] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.222050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.222134] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51d66057-fab4-4026-a132-454b631a43d8 is going to be updated. [ 1145.239028] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.239180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.239254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.239450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.239586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.239737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51d66057-fab4-4026-a132-454b631a43d8" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.244712] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.244841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.244888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.245078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.245211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.252735] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: IN_PROGRESS for 2s [ 1145.370926] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: SUCCESS [ 1145.371191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.704864] env[69647]: INFO networking_nsxv3.common.synchronization [req-2bd11388-e362-4d3a-a978-6151b4231245 req-1aa55160-aec0-48c1-81f4-3a416cb63814 tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1146.706278] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b889aaff-9fca-4d8b-92bf-300934a13f44 with Priority: HIGHEST for action security_group_members [ 1146.706782] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b889aaff-9fca-4d8b-92bf-300934a13f44 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.707014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.707095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.707347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.707580] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.707707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.707819] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.708075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.708170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.708289] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b889aaff-9fca-4d8b-92bf-300934a13f44',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.212199] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.212368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.212439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.212750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.232007] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.232315] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.232471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.232585] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.232828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.232934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.233071] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b889aaff-9fca-4d8b-92bf-300934a13f44 is going to be updated. [ 1147.255551] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.255720] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.255803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.256106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.256263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.261101] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: SUCCESS [ 1147.261334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.261602] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.261868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.262113] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.262166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.262215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.262361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.262442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.262536] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.263866] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: IN_PROGRESS for 2s [ 1147.287282] env[69647]: INFO networking_nsxv3.common.synchronization [req-303e99f3-bac0-4e1e-b9e3-a7dc7e8f7bf8 req-587c38ed-3f11-4003-88eb-e4dac3debdd1 tempest-ServerActionsTestOtherB-626642147 tempest-ServerActionsTestOtherB-626642147-project-member] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1147.287790] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1147.288336] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.288453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.288521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.288728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.288878] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.288973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.289147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.289308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.289394] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.289489] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.583759] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.583988] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.584133] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.584406] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.584707] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.584864] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.585091] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.585345] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.585493] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.585795] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.585914] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.586036] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.586151] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.586265] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.586396] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.586507] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.605774] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.605946] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1147.606133] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.606331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.606640] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-30cf386f-9aa8-4257-9784-692d5cbdfcdc taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.606862] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.606949] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.607302] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.607443] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30cf386f-9aa8-4257-9784-692d5cbdfcdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.764953] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.791809] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.791809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.791972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.792242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.792427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.792674] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.792848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.792960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.793214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.793341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.793468] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be updated. [ 1147.815837] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.816033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.816087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.816266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.816490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.824809] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 1148.113203] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.113475] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.113757] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.114165] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.114407] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.114678] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 30cf386f-9aa8-4257-9784-692d5cbdfcdc not found, creating... [ 1148.115040] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.115285] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.115435] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.115704] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.115891] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.116263] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.116431] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.116583] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.116839] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.117020] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.117201] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 30cf386f-9aa8-4257-9784-692d5cbdfcdc is going to be created. [ 1148.138320] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.138526] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.138659] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.138925] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.139166] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.139438] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.267425] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.770544] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.770942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.770942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.771079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.771195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.771344] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be updated. [ 1148.798952] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.799358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.799542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.799640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.799790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.807847] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: IN_PROGRESS for 2s [ 1148.813801] env[69647]: INFO networking_nsxv3.common.synchronization [req-303e99f3-bac0-4e1e-b9e3-a7dc7e8f7bf8 req-bc97bd84-c980-450d-884e-d223a0edd420 service nova] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 1148.814018] env[69647]: INFO networking_nsxv3.common.synchronization [req-303e99f3-bac0-4e1e-b9e3-a7dc7e8f7bf8 req-bc97bd84-c980-450d-884e-d223a0edd420 service nova] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1148.814159] env[69647]: INFO networking_nsxv3.common.synchronization [req-303e99f3-bac0-4e1e-b9e3-a7dc7e8f7bf8 req-bc97bd84-c980-450d-884e-d223a0edd420 service nova] Enqueued Resource ID: 30cf386f-9aa8-4257-9784-692d5cbdfcdc with Priority: HIGHEST for action port [ 1148.814391] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 1148.814544] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1148.814610] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30cf386f-9aa8-4257-9784-692d5cbdfcdc with Priority: HIGHEST for action port [ 1148.816902] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.816902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.816902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.817232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.817232] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.818650] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.821827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.821827] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-30cf386f-9aa8-4257-9784-692d5cbdfcdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.821827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.821827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.821827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.821827] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30cf386f-9aa8-4257-9784-692d5cbdfcdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.274114] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b889aaff-9fca-4d8b-92bf-300934a13f44 in Status: SUCCESS [ 1149.274283] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b889aaff-9fca-4d8b-92bf-300934a13f44 deletion is rescheduled due to dependency. [ 1149.274400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b889aaff-9fca-4d8b-92bf-300934a13f44" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.302577] env[69647]: INFO networking_nsxv3.common.synchronization [req-81714b3f-6993-40af-943f-ad641f653812 req-5436bb4e-de70-4453-a28e-32f61a6e66c9 tempest-ImagesOneServerNegativeTestJSON-126282846 tempest-ImagesOneServerNegativeTestJSON-126282846-project-member] Enqueued Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1149.303147] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b0043ff-d285-4932-aeae-115f9e86d947 with Priority: HIGHEST for action security_group_members [ 1149.303541] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b0043ff-d285-4932-aeae-115f9e86d947 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.303622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.303622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.303830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.304032] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.304140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.304206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.304360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.304445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.304536] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b0043ff-d285-4932-aeae-115f9e86d947',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.321883] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.321997] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.323799] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30cf386f-9aa8-4257-9784-692d5cbdfcdc with status ACTIVE [ 1149.323992] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.324121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.324206] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.324375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.324475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.324659] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.324814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.324871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.325039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.325118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.325375] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.325448] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.325501] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.325665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.327689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.327689] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30cf386f-9aa8-4257-9784-692d5cbdfcdc is going to be updated. [ 1149.344128] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.344254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.344312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.344486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.344612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.344839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.807102] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.807481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.807481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.807606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.807737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.807921] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.808049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.808113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.808282] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.808358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.808462] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 is going to be updated. [ 1149.834427] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 1149.834579] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 deletion is rescheduled due to dependency. [ 1149.834713] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.834873] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.835074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.835243] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.835350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.835412] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.835557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.835634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.835729] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.837182] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.837311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.837357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.837485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.837613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.843563] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: IN_PROGRESS for 2s [ 1150.339085] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.402230] env[69647]: INFO networking_nsxv3.common.synchronization [req-3ba34b18-31f8-4032-9543-5e3ae904b466 req-dc6f8379-4a06-4eaf-9373-9891960d0320 tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_members [ 1150.402230] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_members [ 1150.402230] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.402230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.402230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.402581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.402581] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.402663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.402663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.402827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.402910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.403016] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d692f86-e9ca-4af4-a87e-f20b0b67b76d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.699019] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-451 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.699196] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.699336] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.699627] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.699918] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.700083] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.700204] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.700793] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.700963] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.701214] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1150.701345] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1150.701461] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1150.701571] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1150.701683] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1150.701791] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1150.701926] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1150.719271] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1150.719503] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1150.719705] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1150.719986] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-451" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.720378] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-c3baa435-35ca-4f83-b221-286dcadf0406 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.720580] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-c3baa435-35ca-4f83-b221-286dcadf0406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.720709] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-c3baa435-35ca-4f83-b221-286dcadf0406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.721086] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-c3baa435-35ca-4f83-b221-286dcadf0406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.721256] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3baa435-35ca-4f83-b221-286dcadf0406',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.816710] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: SUCCESS [ 1150.817185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.817185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.817380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.817574] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.817790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.817790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.817911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.817971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.818081] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.841859] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.905552] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.905732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.905829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.906070] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.906227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.906442] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.906543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.906606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.906766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.906843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.906929] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d already deleted. [ 1150.907013] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.223697] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.223941] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.224046] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.224370] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.224520] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.224720] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port c3baa435-35ca-4f83-b221-286dcadf0406 not found, creating... [ 1151.225035] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.225207] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.225330] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.225556] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.225700] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.226268] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.226511] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.226692] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.226963] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.227232] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.227427] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: c3baa435-35ca-4f83-b221-286dcadf0406 is going to be created. [ 1151.246591] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.246830] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.246945] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.247247] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.247500] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.247732] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-c3baa435-35ca-4f83-b221-286dcadf0406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.320380] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.344777] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.344953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.345054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.345322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.345455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.345577] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be updated. [ 1151.383131] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.383262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.383292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.383590] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.383625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.394640] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 1151.823968] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.852677] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b0043ff-d285-4932-aeae-115f9e86d947 in Status: SUCCESS [ 1151.852949] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b0043ff-d285-4932-aeae-115f9e86d947 deletion is rescheduled due to dependency. [ 1151.853090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b0043ff-d285-4932-aeae-115f9e86d947" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.104670] env[69647]: INFO networking_nsxv3.common.synchronization [req-3ba34b18-31f8-4032-9543-5e3ae904b466 req-f9b14ba2-b928-4277-9a82-b78fc9166004 service nova] Enqueued Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_rules [ 1152.104877] env[69647]: INFO networking_nsxv3.common.synchronization [req-3ba34b18-31f8-4032-9543-5e3ae904b466 req-f9b14ba2-b928-4277-9a82-b78fc9166004 service nova] Enqueued Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_members [ 1152.105044] env[69647]: INFO networking_nsxv3.common.synchronization [req-3ba34b18-31f8-4032-9543-5e3ae904b466 req-f9b14ba2-b928-4277-9a82-b78fc9166004 service nova] Enqueued Resource ID: c3baa435-35ca-4f83-b221-286dcadf0406 with Priority: HIGHEST for action port [ 1152.105642] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_rules [ 1152.107257] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_members [ 1152.107257] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3baa435-35ca-4f83-b221-286dcadf0406 with Priority: HIGHEST for action port [ 1152.107257] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.107257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.107257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.107257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.107257] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d692f86-e9ca-4af4-a87e-f20b0b67b76d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.108196] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.108196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.108196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.108295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.109523] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.109523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.109523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.109523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.109523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.109523] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d692f86-e9ca-4af4-a87e-f20b0b67b76d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.109792] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3baa435-35ca-4f83-b221-286dcadf0406 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.109855] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3baa435-35ca-4f83-b221-286dcadf0406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.109887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3baa435-35ca-4f83-b221-286dcadf0406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.111397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3baa435-35ca-4f83-b221-286dcadf0406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.111397] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3baa435-35ca-4f83-b221-286dcadf0406',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.328122] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.328122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.328122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.328348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.328348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.328348] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be updated. [ 1152.355927] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.356087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.356162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.356359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.356509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.365157] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: IN_PROGRESS for 2s [ 1152.611858] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.611858] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.613217] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d692f86-e9ca-4af4-a87e-f20b0b67b76d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.614486] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3baa435-35ca-4f83-b221-286dcadf0406 with status ACTIVE [ 1152.614486] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.614486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.614486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.614719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.615031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.615031] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.615155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.615189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.615611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.615611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.615611] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.615754] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.615754] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.615884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.615957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.616053] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3baa435-35ca-4f83-b221-286dcadf0406 is going to be updated. [ 1152.635468] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.635666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.635666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.636070] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.636231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.636404] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3baa435-35ca-4f83-b221-286dcadf0406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.118609] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d692f86-e9ca-4af4-a87e-f20b0b67b76d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.406647] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 1153.406647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.406647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.406647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.406647] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.406647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.406647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.406647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.406647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.406647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.406647] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.620946] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.621181] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.621260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.621490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.621582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.621685] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d is going to be created. [ 1153.644397] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.644525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.644617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.644898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.645227] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.654398] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d in Status: UNINITIALIZED for 2s [ 1153.910812] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.375092] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: SUCCESS [ 1154.375511] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.375511] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.375742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.375992] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.376161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.376229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.376398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.376479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.376565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.376742] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.376824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.376913] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.377101] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.377243] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.377338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.377397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.377531] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.377603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.377683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.377771] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.378638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.378936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.378936] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.379072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.379164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.379235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.379311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.379397] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.412778] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c35014e-8d95-4c20-872d-da537d220b20: rpc.has_security_group_logging(os_id): False [ 1154.430423] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.430565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.430635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.430844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.430933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.431203] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.431322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.431387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.431541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.431616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.431703] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be updated. [ 1154.438499] env[69647]: INFO networking_nsxv3.common.synchronization [None req-de1b4592-643b-4a19-840c-15d1d2df4c0c tempest-AttachInterfacesTestJSON-503102750 tempest-AttachInterfacesTestJSON-503102750-project-member] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1154.438539] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGHEST for action security_group_members [ 1154.439692] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.439692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.439692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.439692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.439846] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.439890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.439953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.440094] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.440171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.440259] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.490863] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.490863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.491064] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.491174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.491396] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.503654] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 1154.881399] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad9ffe14-4877-41a7-8b4e-cba70585158e: rpc.has_security_group_logging(os_id): False [ 1154.883027] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.899781] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.899941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.899941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.900176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.900277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.900516] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.900636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.900698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.900909] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.901014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.901229] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.901348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.901426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.901611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.901708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.902247] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.902247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.902247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.902375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.902375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.902489] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be created. [ 1154.942946] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.942946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.942946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.942946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.942946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.942946] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.943308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.943308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.943308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.943395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.943488] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be updated. [ 1154.958934] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.959075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.959143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.959327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.959544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.969683] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: IN_PROGRESS for 2s [ 1154.970437] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.970539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.970599] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.970783] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.970928] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.976841] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: IN_PROGRESS for 2s [ 1155.352148] env[69647]: INFO networking_nsxv3.common.synchronization [req-14f0d7db-fb1a-417e-9e5c-1710a22552c4 req-e838b0ee-0646-4357-8baa-a194cb543a55 tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1155.352726] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1155.353090] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.353415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.353415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.353953] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.354222] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.354380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.354483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.354683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.354925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.354971] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.385333] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.664288] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d in Status: SUCCESS [ 1155.664523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.665051] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.665297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.665511] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.665608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.665704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.665872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.665960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.666060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.666165] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d692f86-e9ca-4af4-a87e-f20b0b67b76d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.857643] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.857804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.857881] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.858136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.858230] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.858424] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.858523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.858584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.858741] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.858817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.858924] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc is going to be updated. [ 1155.885221] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.885221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.885221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.885565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.885612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.891909] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.892176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.892176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.892824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.892824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.892824] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be updated. [ 1155.895550] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: IN_PROGRESS for 2s [ 1155.920682] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.920852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.920852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.922500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.922500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.929491] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: IN_PROGRESS for 2s [ 1156.167812] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d692f86-e9ca-4af4-a87e-f20b0b67b76d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.518022] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 1156.518312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.673080] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d692f86-e9ca-4af4-a87e-f20b0b67b76d: rpc.has_security_group_logging(os_id): False [ 1156.691873] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.692137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.692196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.692487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.692568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.692890] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.693036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.693127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.693392] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.693445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.693544] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d is going to be created. [ 1156.752460] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.753193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.753331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.753639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.753923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.763928] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d in Status: IN_PROGRESS for 2s [ 1156.984272] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: SUCCESS [ 1156.984272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.984272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.984272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.984272] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.985555] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9da9f265-ecd5-4341-a63a-3d1380826075 in Status: SUCCESS [ 1156.985712] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 deletion is rescheduled due to dependency. [ 1156.985838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.487614] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.487747] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.905588] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: SUCCESS [ 1157.905867] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc deletion is rescheduled due to dependency. [ 1157.905941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.937982] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: SUCCESS [ 1157.938213] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.938381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.938604] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.938792] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.938908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.938974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.939138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.939220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.939306] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.939399] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.442202] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.442400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.442483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.442680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.442871] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.442995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.443078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.443250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.443337] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.443423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.443597] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.443675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.443870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.444084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.444261] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.444383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.444463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.444890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.444890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.444890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.444985] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.776565] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d in Status: SUCCESS [ 1158.776813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.947398] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad9ffe14-4877-41a7-8b4e-cba70585158e: rpc.has_security_group_logging(os_id): False [ 1158.963952] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.964111] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.964191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.964464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.964560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.964749] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.964883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.964945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.965110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.965181] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.965376] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.965466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.965525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.965662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.965723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.965934] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.966038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.966094] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.966235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.966302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.966656] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be updated. [ 1159.021971] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.022140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.022140] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.022336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.022452] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.032166] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: IN_PROGRESS for 2s [ 1159.613661] env[69647]: INFO networking_nsxv3.common.synchronization [None req-e37f8a98-cdac-47be-88f3-30607f0b923e tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_rules [ 1159.614299] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_rules [ 1159.614709] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54be61ed-09b8-4c7e-8b2a-07214a54018b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.614949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.615030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.615644] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.615817] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54be61ed-09b8-4c7e-8b2a-07214a54018b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.692452] env[69647]: INFO networking_nsxv3.common.synchronization [None req-6cfb8199-dad5-46b0-87e2-94ad22118f3a tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_rules [ 1159.693429] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_rules [ 1159.694283] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54be61ed-09b8-4c7e-8b2a-07214a54018b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.694437] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.082736] env[69647]: INFO networking_nsxv3.common.synchronization [None req-285682fb-e746-407a-894a-3a64851f8c36 None None] Enqueued Resource ID: 692fb002-2463-41fc-9928-6b1706763d47 with Priority: HIGHEST for action port [ 1160.082736] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 692fb002-2463-41fc-9928-6b1706763d47 with Priority: HIGHEST for action port [ 1160.082736] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-692fb002-2463-41fc-9928-6b1706763d47 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.082736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-692fb002-2463-41fc-9928-6b1706763d47" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.082736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-692fb002-2463-41fc-9928-6b1706763d47" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.082736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-692fb002-2463-41fc-9928-6b1706763d47" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.082736] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('692fb002-2463-41fc-9928-6b1706763d47',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.135488] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.135725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.136256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.136385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.136476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.136573] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b already deleted. [ 1160.136654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.136797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.136950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.137045] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54be61ed-09b8-4c7e-8b2a-07214a54018b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.583751] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 692fb002-2463-41fc-9928-6b1706763d47 [ 1160.584022] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.584167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.584272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.584439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.584530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.584617] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:692fb002-2463-41fc-9928-6b1706763d47 already deleted. [ 1160.584694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-692fb002-2463-41fc-9928-6b1706763d47" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.669117] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.669117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.669117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.669117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.669117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.669117] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b already deleted. [ 1160.669117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.978211] env[69647]: INFO networking_nsxv3.common.synchronization [None req-721c5ed6-a84c-40fc-b96e-dfa68e1f278e tempest-ServersTestJSON-1349905225 tempest-ServersTestJSON-1349905225-project-member] Enqueued Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_rules [ 1160.979278] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_rules [ 1160.979586] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.979800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.979800] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.981055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.981055] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8957cc88-35b6-4fdf-abb0-bfb0a5573c22',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.046287] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: SUCCESS [ 1161.046518] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.046690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.046908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.046996] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.064295] env[69647]: INFO networking_nsxv3.common.synchronization [None req-d4fcac1d-0f65-4cf9-a88f-283974be094c tempest-ServersTestJSON-1349905225 tempest-ServersTestJSON-1349905225-project-member] Enqueued Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_rules [ 1161.065408] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_rules [ 1161.065797] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.065930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.502557] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.502837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.502837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.502983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.503082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.503238] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 already deleted. [ 1161.503269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.505074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.505074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.505074] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8957cc88-35b6-4fdf-abb0-bfb0a5573c22',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.549863] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.550062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.550225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.550369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.550551] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.550654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.550717] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.550876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.550976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.551055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.551152] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.026039] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.026039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.026039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.026039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.026039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.026039] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 already deleted. [ 1162.026039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.056615] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.056615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.056615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.056615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.056615] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.056615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.056824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.056824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.057065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.057065] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.057155] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.057252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.057312] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.057450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.058537] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.058537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.058537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.058537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.058537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.058537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.058537] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.329795] env[69647]: INFO networking_nsxv3.common.synchronization [None req-024b030b-e80e-4523-bde2-525e70fab663 None None] Enqueued Resource ID: 405b94e0-4f3d-4e17-b62f-2d803114f814 with Priority: HIGHEST for action port [ 1162.333033] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 405b94e0-4f3d-4e17-b62f-2d803114f814 with Priority: HIGHEST for action port [ 1162.333033] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-405b94e0-4f3d-4e17-b62f-2d803114f814 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.333033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-405b94e0-4f3d-4e17-b62f-2d803114f814" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.333033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-405b94e0-4f3d-4e17-b62f-2d803114f814" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.333033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-405b94e0-4f3d-4e17-b62f-2d803114f814" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.333033] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('405b94e0-4f3d-4e17-b62f-2d803114f814',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.560334] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad9ffe14-4877-41a7-8b4e-cba70585158e: rpc.has_security_group_logging(os_id): False [ 1162.578963] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.578963] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.579106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.579294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.579332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.579532] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.579624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.579690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.579866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.579903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.580114] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.580205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.580263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.580445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.580494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.580647] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.580864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.580864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.580916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.581190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.581190] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be updated. [ 1162.637463] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.637671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.637671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.637899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.638063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.654026] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: IN_PROGRESS for 2s [ 1162.834173] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 405b94e0-4f3d-4e17-b62f-2d803114f814 [ 1162.834417] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.834550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.834620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.834838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.834987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.835101] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:405b94e0-4f3d-4e17-b62f-2d803114f814 already deleted. [ 1162.835185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-405b94e0-4f3d-4e17-b62f-2d803114f814" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.667241] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: SUCCESS [ 1164.667595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.263848] env[69647]: INFO networking_nsxv3.common.synchronization [req-c0d83bb4-61ad-4b34-a8a8-0e81ef9e4706 req-63eb26b4-4565-47d3-a6b4-54237a729e83 tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_members [ 1165.264535] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_members [ 1165.264956] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-54be61ed-09b8-4c7e-8b2a-07214a54018b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.265094] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.265189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.265505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.265703] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.265829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.265919] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.266147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.266293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.266375] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54be61ed-09b8-4c7e-8b2a-07214a54018b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.559161] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.559372] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.559497] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.559770] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.560042] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.560184] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.560315] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.560533] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.560678] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.560904] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.561029] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.561167] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.561295] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.561387] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.561495] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.561633] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.579737] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.579737] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1165.579953] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.580133] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.580451] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-e760fd80-64e0-45b9-8100-89b9bedf91dc taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.580620] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-e760fd80-64e0-45b9-8100-89b9bedf91dc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.580749] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-e760fd80-64e0-45b9-8100-89b9bedf91dc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.581835] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-e760fd80-64e0-45b9-8100-89b9bedf91dc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.581835] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e760fd80-64e0-45b9-8100-89b9bedf91dc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.768365] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.768694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.768694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.768791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.768980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.769081] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.769174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.769238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.769380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.769456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.769540] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b already deleted. [ 1165.769620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.845931] env[69647]: INFO networking_nsxv3.common.synchronization [req-045fc864-9d0b-4b79-98ca-f78ed637ed15 req-31ba3fba-45d5-4283-9fcd-947babe9fafd tempest-ListServerFiltersTestJSON-8610940 tempest-ListServerFiltersTestJSON-8610940-project-member] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1165.846488] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1165.846789] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.846912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.846979] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.847189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.847366] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.847465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.847525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.847673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.847757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.847847] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.083643] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.083873] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.084015] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.084704] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.084704] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.084704] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port e760fd80-64e0-45b9-8100-89b9bedf91dc not found, creating... [ 1166.084875] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.085132] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.085317] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.085547] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.085689] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.085984] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.086164] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.086283] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.086494] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.086627] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.086770] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: e760fd80-64e0-45b9-8100-89b9bedf91dc is going to be created. [ 1166.109171] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.109464] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.109667] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.109991] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.110294] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.110577] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-e760fd80-64e0-45b9-8100-89b9bedf91dc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.350765] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.853311] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.985318] env[69647]: INFO networking_nsxv3.common.synchronization [req-c0d83bb4-61ad-4b34-a8a8-0e81ef9e4706 req-7aa9a016-8329-4107-aee8-1a45f25e9cfa service nova] Enqueued Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_rules [ 1166.985560] env[69647]: INFO networking_nsxv3.common.synchronization [req-c0d83bb4-61ad-4b34-a8a8-0e81ef9e4706 req-7aa9a016-8329-4107-aee8-1a45f25e9cfa service nova] Enqueued Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_members [ 1166.985646] env[69647]: INFO networking_nsxv3.common.synchronization [req-c0d83bb4-61ad-4b34-a8a8-0e81ef9e4706 req-7aa9a016-8329-4107-aee8-1a45f25e9cfa service nova] Enqueued Resource ID: e760fd80-64e0-45b9-8100-89b9bedf91dc with Priority: HIGHEST for action port [ 1166.985880] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_rules [ 1166.986014] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_members [ 1166.986146] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e760fd80-64e0-45b9-8100-89b9bedf91dc with Priority: HIGHEST for action port [ 1166.986699] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54be61ed-09b8-4c7e-8b2a-07214a54018b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.986803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.986873] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.987286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.987368] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54be61ed-09b8-4c7e-8b2a-07214a54018b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.988575] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-54be61ed-09b8-4c7e-8b2a-07214a54018b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.988708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.988749] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.989356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.989356] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.989356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.989356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.989533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.989533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.989648] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54be61ed-09b8-4c7e-8b2a-07214a54018b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.990899] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-e760fd80-64e0-45b9-8100-89b9bedf91dc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.991093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e760fd80-64e0-45b9-8100-89b9bedf91dc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.991170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e760fd80-64e0-45b9-8100-89b9bedf91dc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.991418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e760fd80-64e0-45b9-8100-89b9bedf91dc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.991498] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e760fd80-64e0-45b9-8100-89b9bedf91dc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.355706] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.355934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.356110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.356439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.356586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.356719] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be updated. [ 1167.382889] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.383426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.383426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.383572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.383628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.391477] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: IN_PROGRESS for 2s [ 1167.489053] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-54be61ed-09b8-4c7e-8b2a-07214a54018b taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.489178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.491546] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54be61ed-09b8-4c7e-8b2a-07214a54018b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.493516] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e760fd80-64e0-45b9-8100-89b9bedf91dc with status ACTIVE [ 1167.493703] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.493957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.493957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.494691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.494691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.494691] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.494691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.494691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.494691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.495071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.495071] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.495071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.495199] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.495231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.495427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.495427] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e760fd80-64e0-45b9-8100-89b9bedf91dc is going to be updated. [ 1167.516501] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.516684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.516827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.516906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.517054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.517873] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e760fd80-64e0-45b9-8100-89b9bedf91dc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.545022] env[69647]: INFO networking_nsxv3.common.synchronization [req-c1e60f93-5424-414d-afa6-dc199bd47404 req-0b7979e5-7848-447e-9ed4-b3d31e590370 tempest-ServersTestJSON-1349905225 tempest-ServersTestJSON-1349905225-project-member] Enqueued Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_members [ 1167.545725] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_members [ 1167.546155] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.546310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.546443] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.546750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.546931] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.547124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.547192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.547450] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.547566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.547692] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8957cc88-35b6-4fdf-abb0-bfb0a5573c22',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.825227] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.825477] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-612" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.825611] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-612" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.825973] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-612" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.826612] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.826789] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.826897] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.827154] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.827366] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.827594] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.827710] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1167.827819] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1167.827927] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1167.828047] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.828156] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1167.828292] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1167.845828] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1167.846125] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1167.846219] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1167.846328] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-612" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.846609] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-84156000-3a56-40a2-83cf-cf5af97640fb taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.846774] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-84156000-3a56-40a2-83cf-cf5af97640fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.846888] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-84156000-3a56-40a2-83cf-cf5af97640fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.847185] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-84156000-3a56-40a2-83cf-cf5af97640fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.847332] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84156000-3a56-40a2-83cf-cf5af97640fb',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.997644] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54be61ed-09b8-4c7e-8b2a-07214a54018b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.050402] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.050402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.050564] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.050651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.050739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.050926] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.051035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.051097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.051248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.051321] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.051404] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 already deleted. [ 1168.051480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.349611] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.350787] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.350787] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.350787] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.350787] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.350787] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 84156000-3a56-40a2-83cf-cf5af97640fb not found, creating... [ 1168.350787] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.351084] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.351084] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.351256] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.351395] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.351679] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.351834] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.351953] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.352185] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.352322] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.352460] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 84156000-3a56-40a2-83cf-cf5af97640fb is going to be created. [ 1168.375091] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.375302] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.375431] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.375670] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.375893] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.376124] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-84156000-3a56-40a2-83cf-cf5af97640fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.499949] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.500167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.500234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.500526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.500638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.500638] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b is going to be created. [ 1168.529742] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.529922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.530033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.530260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.530422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.544456] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b in Status: UNINITIALIZED for 2s [ 1169.137627] env[69647]: INFO networking_nsxv3.common.synchronization [req-c1e60f93-5424-414d-afa6-dc199bd47404 req-104184a7-bc57-44f5-91ac-6b9397f67f3f service nova] Enqueued Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_rules [ 1169.137860] env[69647]: INFO networking_nsxv3.common.synchronization [req-c1e60f93-5424-414d-afa6-dc199bd47404 req-104184a7-bc57-44f5-91ac-6b9397f67f3f service nova] Enqueued Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_members [ 1169.137973] env[69647]: INFO networking_nsxv3.common.synchronization [req-c1e60f93-5424-414d-afa6-dc199bd47404 req-104184a7-bc57-44f5-91ac-6b9397f67f3f service nova] Enqueued Resource ID: 84156000-3a56-40a2-83cf-cf5af97640fb with Priority: HIGHEST for action port [ 1169.138199] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_rules [ 1169.138329] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_members [ 1169.138424] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84156000-3a56-40a2-83cf-cf5af97640fb with Priority: HIGHEST for action port [ 1169.139593] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.139715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.139785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.139975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.140078] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8957cc88-35b6-4fdf-abb0-bfb0a5573c22',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.141389] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.141389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.141505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.141625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.141773] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.141866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.141922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.142072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.142166] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.142244] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8957cc88-35b6-4fdf-abb0-bfb0a5573c22',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.142948] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-84156000-3a56-40a2-83cf-cf5af97640fb taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.143075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84156000-3a56-40a2-83cf-cf5af97640fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.143134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84156000-3a56-40a2-83cf-cf5af97640fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.143263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84156000-3a56-40a2-83cf-cf5af97640fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.143337] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84156000-3a56-40a2-83cf-cf5af97640fb',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.400836] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: SUCCESS [ 1169.401197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.642375] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.642375] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.645496] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84156000-3a56-40a2-83cf-cf5af97640fb with status ACTIVE [ 1169.645697] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.647272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.647272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.647272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.647272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.647272] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.647272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.647272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.647272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.647272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.647272] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.647272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.647272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.647920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.647920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.647920] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84156000-3a56-40a2-83cf-cf5af97640fb is going to be updated. [ 1169.649217] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8957cc88-35b6-4fdf-abb0-bfb0a5573c22',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.668829] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.668983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.669105] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.669304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.669440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.669597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84156000-3a56-40a2-83cf-cf5af97640fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.151240] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8957cc88-35b6-4fdf-abb0-bfb0a5573c22',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.554040] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b in Status: SUCCESS [ 1170.554126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.554287] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.554512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.554704] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.554816] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.554880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.555080] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.555162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.555248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.555335] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54be61ed-09b8-4c7e-8b2a-07214a54018b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.653889] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.654046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.654124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.654317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.654911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.654911] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 is going to be created. [ 1170.678192] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.678192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.678192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.678513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.678513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.687367] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 in Status: UNINITIALIZED for 2s [ 1171.057186] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54be61ed-09b8-4c7e-8b2a-07214a54018b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.559407] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54be61ed-09b8-4c7e-8b2a-07214a54018b: rpc.has_security_group_logging(os_id): False [ 1171.575820] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.576009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.576098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.576288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.576380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.576610] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.576892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.576892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.576945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.576971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.577100] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b is going to be created. [ 1171.630521] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.630715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.630715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.630923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.631120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.651882] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b in Status: IN_PROGRESS for 2s [ 1172.470370] env[69647]: INFO networking_nsxv3.common.synchronization [req-fd2bf638-a3f9-45fe-a662-65d17d1e3f77 req-36dfba19-73be-46ed-8708-ff0dd888b948 tempest-ListServerFiltersTestJSON-8610940 tempest-ListServerFiltersTestJSON-8610940-project-member] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1172.470370] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1172.470370] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.470499] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.470592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.470762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.470910] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.471011] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.471158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.471332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.471449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.471855] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.697246] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 in Status: SUCCESS [ 1172.697654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.697654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.697822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.698014] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.698130] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.698204] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.698343] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.698414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.698497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.698589] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8957cc88-35b6-4fdf-abb0-bfb0a5573c22',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.973736] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.202124] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8957cc88-35b6-4fdf-abb0-bfb0a5573c22',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.476218] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.663526] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b in Status: SUCCESS [ 1173.663526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.704108] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8957cc88-35b6-4fdf-abb0-bfb0a5573c22: rpc.has_security_group_logging(os_id): False [ 1173.720378] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.720555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.720625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.720835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.720923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.721179] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.721279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.721390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.721543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.721618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.721707] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 is going to be created. [ 1173.789254] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.789461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.789461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.789651] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.789819] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.799234] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 in Status: IN_PROGRESS for 2s [ 1173.979099] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.979254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.979334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.979542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.979633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.979732] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be updated. [ 1174.005781] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.005937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.005994] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.006255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.006324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.014472] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: IN_PROGRESS for 2s [ 1175.809668] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 in Status: SUCCESS [ 1175.809918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.025593] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: SUCCESS [ 1176.025799] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.471524] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1177.471524] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1179.072422] env[69647]: INFO networking_nsxv3.common.synchronization [req-afd2de6a-65ba-42aa-9d61-f1c5fe53d0be req-8f340207-8b84-4bf1-9505-8f55f495cfbe tempest-ListServerFiltersTestJSON-8610940 tempest-ListServerFiltersTestJSON-8610940-project-member] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1179.072958] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGHEST for action security_group_members [ 1179.073284] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.073410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.073475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.073667] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.073817] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.073917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.073980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.074336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.074336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.074336] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.577232] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.577494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.577494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.577771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.577875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.578094] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.578218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.578286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.578414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.578486] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.578580] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be updated. [ 1179.606410] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.606589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.606627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.606969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.606969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.614475] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: IN_PROGRESS for 2s [ 1181.625952] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ffe14-4877-41a7-8b4e-cba70585158e in Status: SUCCESS [ 1181.626331] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e deletion is rescheduled due to dependency. [ 1181.626331] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.590050] env[69647]: INFO networking_nsxv3.common.synchronization [req-59a7c04d-6cb6-43c8-bf98-1d259c9accfb req-1d9c03a1-b3d8-4db5-8d30-9f9824686c7f tempest-AttachVolumeShelveTestJSON-989009573 tempest-AttachVolumeShelveTestJSON-989009573-project-member] Enqueued Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_members [ 1182.590268] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 with Priority: HIGHEST for action security_group_members [ 1182.590910] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.591148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.591234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.591434] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.592136] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.592136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.592136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.592136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.592136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.592136] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.094183] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.094628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.094628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.094704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.094787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.094986] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.095098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.095161] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.095362] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.095439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.095531] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 is going to be updated. [ 1183.119552] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.119677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.119744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.119923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.120069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.128780] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 in Status: IN_PROGRESS for 2s [ 1185.139472] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 in Status: SUCCESS [ 1185.139472] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190 deletion is rescheduled due to dependency. [ 1185.139472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.533687] env[69647]: INFO networking_nsxv3.common.synchronization [None req-40f8b42d-28b6-4e10-8be0-c969624a783b None None] Enqueued Resource ID: ca9b1e0f-f2be-45ff-aa88-53b4078cd406 with Priority: HIGHEST for action port [ 1185.533928] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9b1e0f-f2be-45ff-aa88-53b4078cd406 with Priority: HIGHEST for action port [ 1185.534527] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca9b1e0f-f2be-45ff-aa88-53b4078cd406 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.534761] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca9b1e0f-f2be-45ff-aa88-53b4078cd406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.534761] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca9b1e0f-f2be-45ff-aa88-53b4078cd406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.535044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca9b1e0f-f2be-45ff-aa88-53b4078cd406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.535643] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca9b1e0f-f2be-45ff-aa88-53b4078cd406',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.038176] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca9b1e0f-f2be-45ff-aa88-53b4078cd406 [ 1186.038328] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.038384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.038497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.039541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.039541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.039541] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca9b1e0f-f2be-45ff-aa88-53b4078cd406 already deleted. [ 1186.039541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca9b1e0f-f2be-45ff-aa88-53b4078cd406" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.534592] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1190.535044] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1195.535191] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1195.535519] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1200.536154] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.536680] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1205.537565] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1205.537795] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1210.539137] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1210.539525] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1210.583665] env[69647]: INFO networking_nsxv3.common.synchronization [req-7462539a-ae0a-4c8d-92a6-aaad6dfa9661 req-77555108-fe0f-4c1e-b33f-bf601fb87bed tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1210.584204] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1210.584500] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.585031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.585112] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.585356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.585461] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.585562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.585693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.585849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.585933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.586037] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.090059] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.090059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.090059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.090059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.090411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.090411] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.090496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.090577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.090755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.090850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.090953] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be updated. [ 1211.118562] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.119551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.119551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.119551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.119551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.130051] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: IN_PROGRESS for 2s [ 1213.140352] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: SUCCESS [ 1213.140686] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 deletion is rescheduled due to dependency. [ 1213.140686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.484975] env[69647]: INFO networking_nsxv3.common.synchronization [req-65e5a99d-70a8-4e0e-ae6d-273d3c984729 req-6dc38ae5-9c03-4dda-bd52-7f615ec74961 tempest-AttachVolumeNegativeTest-1481956129 tempest-AttachVolumeNegativeTest-1481956129-project-member] Enqueued Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_members [ 1215.485460] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGHEST for action security_group_members [ 1215.485596] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.485760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.485828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.486039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.486191] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.486286] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.486345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.486484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.486568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.486689] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d692f86-e9ca-4af4-a87e-f20b0b67b76d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.990995] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.991217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.991292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.991474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.991563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.991768] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.991867] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.991933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.992087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.992158] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.992244] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d is going to be updated. [ 1216.018268] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.018407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.018804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.018804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.018892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.026890] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d in Status: IN_PROGRESS for 2s [ 1218.037552] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d in Status: SUCCESS [ 1218.037951] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d deletion is rescheduled due to dependency. [ 1218.037951] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.524083] env[69647]: INFO networking_nsxv3.common.synchronization [req-604860e9-483e-430c-bbe4-4985f52553b4 req-a8aa589c-0bd9-4e33-826c-acf4a784ec3c tempest-ServersTestJSON-1349905225 tempest-ServersTestJSON-1349905225-project-member] Enqueued Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_members [ 1218.524456] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 with Priority: HIGHEST for action security_group_members [ 1218.524998] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.524998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.525152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.525431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.525744] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.525908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.526542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.526542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.526542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.526542] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8957cc88-35b6-4fdf-abb0-bfb0a5573c22',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.029323] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.029537] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.029586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.029803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.029915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.030195] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.030318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.030318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.030485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.030580] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.030674] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 is going to be updated. [ 1219.056853] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.057176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.057176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.057252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.057367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.065944] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 in Status: IN_PROGRESS for 2s [ 1219.090895] env[69647]: INFO networking_nsxv3.common.synchronization [req-fa1447d9-3d3d-4cb6-b10a-8e17011ea144 req-25a7a107-1b0e-45dd-8501-e79496146071 tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1219.091131] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1219.091432] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.091574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.091665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.091883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.092088] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.092242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.092343] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.092574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.092704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.092845] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.377039] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.377258] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.377392] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.377665] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.377925] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.378116] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.378242] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.378463] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.378608] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.378832] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.378950] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.379075] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.379189] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.379304] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.379412] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.379550] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.398759] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.398926] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1219.399080] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.399275] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-690" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.399559] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-14e2f4aa-b63c-4b96-9fd7-576ff3f9db37 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.399731] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-14e2f4aa-b63c-4b96-9fd7-576ff3f9db37" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.399855] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-14e2f4aa-b63c-4b96-9fd7-576ff3f9db37" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.400182] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-14e2f4aa-b63c-4b96-9fd7-576ff3f9db37" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.400362] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e2f4aa-b63c-4b96-9fd7-576ff3f9db37',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.595594] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.596033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.596033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.596146] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.596176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.596372] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.596469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.596536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.596673] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.596753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.596861] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be updated. [ 1219.622031] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.622031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.622031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.622308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.622458] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.632453] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: IN_PROGRESS for 2s [ 1219.902952] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.903461] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.903713] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.904155] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.904434] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.904732] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 14e2f4aa-b63c-4b96-9fd7-576ff3f9db37 not found, creating... [ 1219.905201] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.905493] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.905763] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.906131] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.906379] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.906834] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.907113] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.907348] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.907701] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.908027] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.908253] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 14e2f4aa-b63c-4b96-9fd7-576ff3f9db37 is going to be created. [ 1219.927504] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.927716] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.927898] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.928208] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.928444] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.928677] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-14e2f4aa-b63c-4b96-9fd7-576ff3f9db37" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.612113] env[69647]: INFO networking_nsxv3.common.synchronization [req-fa1447d9-3d3d-4cb6-b10a-8e17011ea144 req-bec785e8-32f1-476d-9816-ffdcebacaf68 service nova] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_rules [ 1220.612529] env[69647]: INFO networking_nsxv3.common.synchronization [req-fa1447d9-3d3d-4cb6-b10a-8e17011ea144 req-bec785e8-32f1-476d-9816-ffdcebacaf68 service nova] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1220.612529] env[69647]: INFO networking_nsxv3.common.synchronization [req-fa1447d9-3d3d-4cb6-b10a-8e17011ea144 req-bec785e8-32f1-476d-9816-ffdcebacaf68 service nova] Enqueued Resource ID: 14e2f4aa-b63c-4b96-9fd7-576ff3f9db37 with Priority: HIGHEST for action port [ 1220.612605] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_rules [ 1220.612692] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1220.612791] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e2f4aa-b63c-4b96-9fd7-576ff3f9db37 with Priority: HIGHEST for action port [ 1220.613762] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.613904] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.613974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.614378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.614476] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.615686] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.615870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.616949] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-14e2f4aa-b63c-4b96-9fd7-576ff3f9db37 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.616949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14e2f4aa-b63c-4b96-9fd7-576ff3f9db37" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.616949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14e2f4aa-b63c-4b96-9fd7-576ff3f9db37" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.616949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14e2f4aa-b63c-4b96-9fd7-576ff3f9db37" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.616949] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e2f4aa-b63c-4b96-9fd7-576ff3f9db37',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.076034] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 in Status: SUCCESS [ 1221.076034] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8957cc88-35b6-4fdf-abb0-bfb0a5573c22 deletion is rescheduled due to dependency. [ 1221.076034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8957cc88-35b6-4fdf-abb0-bfb0a5573c22" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.116169] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.116305] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.118700] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14e2f4aa-b63c-4b96-9fd7-576ff3f9db37 with status ACTIVE [ 1221.118903] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.119038] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.119116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.119529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.119529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.119626] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.119687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.119718] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.119854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.119926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.120165] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.120264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.120319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.120462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.120535] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.120620] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14e2f4aa-b63c-4b96-9fd7-576ff3f9db37 is going to be updated. [ 1221.140112] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.140325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.140325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.140544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.140681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.140838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14e2f4aa-b63c-4b96-9fd7-576ff3f9db37" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.641873] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: SUCCESS [ 1221.642255] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 deletion is rescheduled due to dependency. [ 1221.642255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.642329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.642495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.642676] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.642784] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.642851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.643016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.643102] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.643200] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.146050] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.648550] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.151296] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.151492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.151548] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.151753] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.151843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.151946] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be updated. [ 1223.182847] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.183039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.183079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.183296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.183445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.191878] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: IN_PROGRESS for 2s [ 1223.365877] env[69647]: INFO networking_nsxv3.common.synchronization [None req-ad0db0e5-2728-4325-87e5-95ca1f25d759 None None] Enqueued Resource ID: de595751-f1be-4dc7-b321-7625dc5a0c4b with Priority: HIGHEST for action port [ 1223.366501] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de595751-f1be-4dc7-b321-7625dc5a0c4b with Priority: HIGHEST for action port [ 1223.366855] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-de595751-f1be-4dc7-b321-7625dc5a0c4b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.366983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de595751-f1be-4dc7-b321-7625dc5a0c4b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.367064] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de595751-f1be-4dc7-b321-7625dc5a0c4b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.367334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de595751-f1be-4dc7-b321-7625dc5a0c4b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.367418] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de595751-f1be-4dc7-b321-7625dc5a0c4b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.868996] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de595751-f1be-4dc7-b321-7625dc5a0c4b [ 1223.869283] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.869445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.869445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.869695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.869730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.869845] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de595751-f1be-4dc7-b321-7625dc5a0c4b already deleted. [ 1223.869914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de595751-f1be-4dc7-b321-7625dc5a0c4b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.202809] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: SUCCESS [ 1225.203083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.203216] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.203422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.203612] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.203730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.203809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.203944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.204034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.204121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.204212] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.287114] env[69647]: INFO networking_nsxv3.common.synchronization [None req-f42985d9-a5be-4a20-8a0c-bdc529dc2bf3 None None] Enqueued Resource ID: c3e731cb-833d-43fc-8221-be5cfc232721 with Priority: HIGHEST for action port [ 1225.287611] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e731cb-833d-43fc-8221-be5cfc232721 with Priority: HIGHEST for action port [ 1225.287914] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3e731cb-833d-43fc-8221-be5cfc232721 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.288078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3e731cb-833d-43fc-8221-be5cfc232721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.288143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3e731cb-833d-43fc-8221-be5cfc232721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.288376] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3e731cb-833d-43fc-8221-be5cfc232721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.288459] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3e731cb-833d-43fc-8221-be5cfc232721',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.706400] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.796801] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3e731cb-833d-43fc-8221-be5cfc232721 [ 1225.796801] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.796801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.796801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.796801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.796801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.796801] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3e731cb-833d-43fc-8221-be5cfc232721 already deleted. [ 1225.796801] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3e731cb-833d-43fc-8221-be5cfc232721" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.208283] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efccc372-9e22-4eea-9577-4fd80da780f3: rpc.has_security_group_logging(os_id): False [ 1226.225643] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.225854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.225949] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.226177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.226268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.226524] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.226624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.226689] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.226974] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.227127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.227235] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be updated. [ 1226.283537] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.283670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.283748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.283968] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.284126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.295845] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: IN_PROGRESS for 2s [ 1228.309406] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: SUCCESS [ 1228.309782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.289126] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.289527] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1230.682136] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.682363] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.682496] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.682777] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.683422] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.683597] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.683722] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.683966] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.684296] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.684576] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.684707] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1230.684821] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1230.684933] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1230.685060] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1230.685173] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1230.685311] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1230.704449] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1230.704551] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1230.704692] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1230.704870] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-318" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.705186] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-30cf386f-9aa8-4257-9784-692d5cbdfcdc taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.705357] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.705481] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.705749] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.705933] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30cf386f-9aa8-4257-9784-692d5cbdfcdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.208233] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.208557] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.208701] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.208999] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.209177] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.209865] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.209865] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.209865] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.210054] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.210264] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.210547] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.210547] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.210713] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.210855] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.210992] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.211238] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 30cf386f-9aa8-4257-9784-692d5cbdfcdc is going to be updated. [ 1231.233452] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.233642] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.233769] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.234395] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.234596] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.235267] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.290151] env[69647]: INFO networking_nsxv3.common.synchronization [None req-6bdf5c23-1e7a-4a4d-877a-dbe8cdbde4a5 None None] Enqueued Resource ID: 67d54460-faae-4dca-a6f5-34b966a0af74 with Priority: HIGHEST for action port [ 1231.290709] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67d54460-faae-4dca-a6f5-34b966a0af74 with Priority: HIGHEST for action port [ 1231.291194] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-67d54460-faae-4dca-a6f5-34b966a0af74 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.291297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67d54460-faae-4dca-a6f5-34b966a0af74" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.291393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67d54460-faae-4dca-a6f5-34b966a0af74" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.291847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67d54460-faae-4dca-a6f5-34b966a0af74" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.291978] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67d54460-faae-4dca-a6f5-34b966a0af74',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.795028] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67d54460-faae-4dca-a6f5-34b966a0af74 [ 1231.795503] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.796442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.796442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.796442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.796442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.796442] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67d54460-faae-4dca-a6f5-34b966a0af74 already deleted. [ 1231.796442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67d54460-faae-4dca-a6f5-34b966a0af74" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.935281] env[69647]: INFO networking_nsxv3.common.synchronization [req-c67784f4-8dee-4307-b295-bf756a558087 req-b4d61e78-a606-4ed8-8f0e-e4cf1728fcf8 service nova] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 1231.935281] env[69647]: INFO networking_nsxv3.common.synchronization [req-c67784f4-8dee-4307-b295-bf756a558087 req-b4d61e78-a606-4ed8-8f0e-e4cf1728fcf8 service nova] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1231.935281] env[69647]: INFO networking_nsxv3.common.synchronization [req-c67784f4-8dee-4307-b295-bf756a558087 req-b4d61e78-a606-4ed8-8f0e-e4cf1728fcf8 service nova] Enqueued Resource ID: 30cf386f-9aa8-4257-9784-692d5cbdfcdc with Priority: HIGHEST for action port [ 1231.935281] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_rules [ 1231.935281] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1231.935281] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30cf386f-9aa8-4257-9784-692d5cbdfcdc with Priority: HIGHEST for action port [ 1231.937466] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.937466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.937466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.937466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.937466] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.938702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.940023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.940023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.940023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.940023] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.940023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.940023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.940023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.940023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.940023] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.941669] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-30cf386f-9aa8-4257-9784-692d5cbdfcdc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.941771] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.941834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.942284] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.942357] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30cf386f-9aa8-4257-9784-692d5cbdfcdc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.440131] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.440458] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.442810] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.445718] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30cf386f-9aa8-4257-9784-692d5cbdfcdc with status ACTIVE [ 1232.445992] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.446174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.446208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.446402] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.446489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.446673] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.446772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.446878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.447977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.447977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.447977] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.447977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.447977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.447977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.447977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.447977] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30cf386f-9aa8-4257-9784-692d5cbdfcdc is going to be updated. [ 1232.469507] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.469722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.469722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.469925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.470084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.470354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30cf386f-9aa8-4257-9784-692d5cbdfcdc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.945805] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.410510] env[69647]: INFO networking_nsxv3.common.synchronization [req-442949e5-4194-4ab8-a396-02f15a172e8e req-1f7e1b2d-aeab-4ce0-9c93-6ae34835b60f tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1233.410959] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1233.411271] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.411381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.411445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.411702] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.411856] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.411945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.411999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.412260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.412345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.412437] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.448538] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.448932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.448932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.448932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.449058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.449176] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be updated. [ 1233.477959] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.478116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.478190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.478551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.478734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.487792] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 1233.503516] env[69647]: INFO networking_nsxv3.common.synchronization [None req-a08e041e-0f3f-4e00-ab4c-dcbf37dfa7d4 None None] Enqueued Resource ID: 8c2cf879-1823-4e06-8354-6baddc71a90f with Priority: HIGHEST for action port [ 1233.503516] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c2cf879-1823-4e06-8354-6baddc71a90f with Priority: HIGHEST for action port [ 1233.504981] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c2cf879-1823-4e06-8354-6baddc71a90f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.504981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c2cf879-1823-4e06-8354-6baddc71a90f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.504981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c2cf879-1823-4e06-8354-6baddc71a90f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.504981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c2cf879-1823-4e06-8354-6baddc71a90f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.504981] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c2cf879-1823-4e06-8354-6baddc71a90f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.719948] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.720168] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.720295] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.720636] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.720905] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.721084] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.721208] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.721422] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.721567] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.721779] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1233.721895] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1233.722013] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1233.722127] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1233.722238] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1233.722343] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1233.722475] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1233.739124] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1233.739314] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1233.739459] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1233.739640] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.739958] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-237849a8-76e4-4fff-8b3f-6f871cbe6298 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.740154] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-237849a8-76e4-4fff-8b3f-6f871cbe6298" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.740275] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-237849a8-76e4-4fff-8b3f-6f871cbe6298" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.740595] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-237849a8-76e4-4fff-8b3f-6f871cbe6298" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.740836] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('237849a8-76e4-4fff-8b3f-6f871cbe6298',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.917809] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.917970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.918046] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.918358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.918488] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.918647] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.918752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.918811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.918971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.919138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.919230] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a already deleted. [ 1233.919324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.007196] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c2cf879-1823-4e06-8354-6baddc71a90f [ 1234.007454] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.007592] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.007663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.007884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.007978] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.008129] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c2cf879-1823-4e06-8354-6baddc71a90f already deleted. [ 1234.008179] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c2cf879-1823-4e06-8354-6baddc71a90f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.243328] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.244176] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.244176] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.244176] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.244176] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.244337] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 237849a8-76e4-4fff-8b3f-6f871cbe6298 not found, creating... [ 1234.244654] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.244833] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.244956] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.245200] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.245340] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.245627] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.245787] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.245912] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.246172] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.246314] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.246456] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 237849a8-76e4-4fff-8b3f-6f871cbe6298 is going to be created. [ 1234.267638] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.267831] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.267960] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.268233] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.268458] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.268679] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-237849a8-76e4-4fff-8b3f-6f871cbe6298" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.987196] env[69647]: INFO networking_nsxv3.common.synchronization [req-442949e5-4194-4ab8-a396-02f15a172e8e req-9979a1ca-3da1-4421-bdc5-df0d7633f1a6 service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1234.987473] env[69647]: INFO networking_nsxv3.common.synchronization [req-442949e5-4194-4ab8-a396-02f15a172e8e req-9979a1ca-3da1-4421-bdc5-df0d7633f1a6 service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1234.987531] env[69647]: INFO networking_nsxv3.common.synchronization [req-442949e5-4194-4ab8-a396-02f15a172e8e req-9979a1ca-3da1-4421-bdc5-df0d7633f1a6 service nova] Enqueued Resource ID: 237849a8-76e4-4fff-8b3f-6f871cbe6298 with Priority: HIGHEST for action port [ 1234.987760] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1234.987886] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1234.988009] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237849a8-76e4-4fff-8b3f-6f871cbe6298 with Priority: HIGHEST for action port [ 1234.988544] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.988714] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.988748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.988976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.989128] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.990145] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.991383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.991383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.991383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.991383] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.991383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.991383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.991383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.991383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.991383] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.991857] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-237849a8-76e4-4fff-8b3f-6f871cbe6298 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.991857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-237849a8-76e4-4fff-8b3f-6f871cbe6298" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.991857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-237849a8-76e4-4fff-8b3f-6f871cbe6298" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.992131] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-237849a8-76e4-4fff-8b3f-6f871cbe6298" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.992131] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('237849a8-76e4-4fff-8b3f-6f871cbe6298',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.494047] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.495072] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.495217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.495381] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 237849a8-76e4-4fff-8b3f-6f871cbe6298 with status ACTIVE [ 1235.495569] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.495678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.495743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.495991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.496090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.496265] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.496359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.496417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.496650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.496921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.497704] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.497886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.497946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.498067] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.498157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.498252] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 237849a8-76e4-4fff-8b3f-6f871cbe6298 is going to be updated. [ 1235.500990] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 1235.501194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.501345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.501507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.501659] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.501757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.501815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.501955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.502040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.502121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.502208] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.524912] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.524912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.525157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.525335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.525502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.525619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-237849a8-76e4-4fff-8b3f-6f871cbe6298" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.001790] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.004379] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.504382] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.504619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.504619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.504842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.504934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.505043] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be created. [ 1236.506864] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c35014e-8d95-4c20-872d-da537d220b20: rpc.has_security_group_logging(os_id): False [ 1236.522959] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.523234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.523234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.523422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.523517] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.523783] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.523878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.524039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.524217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.524313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.524403] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be updated. [ 1236.528206] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.528389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.528389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.528564] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.528719] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.537700] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: UNINITIALIZED for 2s [ 1236.581081] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.582390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.582390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.582390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.582390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.597781] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 1237.584477] env[69647]: INFO networking_nsxv3.common.synchronization [req-0a5ae142-b78f-4523-addb-f3a088b516e1 req-55dd4080-5121-4af8-806e-f5a8b1a3659c tempest-ServerAddressesNegativeTestJSON-793100674 tempest-ServerAddressesNegativeTestJSON-793100674-project-member] Enqueued Resource ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d with Priority: HIGHEST for action security_group_members [ 1237.585217] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d with Priority: HIGHEST for action security_group_members [ 1237.585627] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c8a8134-468e-45a8-a7ad-121c2c56d34d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.585776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.585887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.586295] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.586513] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.586661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.586733] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.586959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.587090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.587215] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c8a8134-468e-45a8-a7ad-121c2c56d34d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.856903] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-181 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.857163] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-181" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.857303] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-181" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.857683] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-181" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.857996] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.858324] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.858447] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.858746] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.859076] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.859325] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1237.859488] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1237.859655] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1237.859789] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1237.859914] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1237.860035] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1237.860213] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1237.879244] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1237.879485] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1237.879698] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1237.879953] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-181" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.880301] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-b273769d-bb84-4057-857d-12c9941249fb taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.880477] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-b273769d-bb84-4057-857d-12c9941249fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.880668] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-b273769d-bb84-4057-857d-12c9941249fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.881107] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-b273769d-bb84-4057-857d-12c9941249fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.881333] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b273769d-bb84-4057-857d-12c9941249fb',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.089203] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.089396] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.089446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.089671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.089751] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.089963] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.090083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.090135] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.090274] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.090353] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.090716] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d already deleted. [ 1238.090716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.384287] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.384523] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.384654] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.385051] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.385227] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.385392] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port b273769d-bb84-4057-857d-12c9941249fb not found, creating... [ 1238.385707] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.385923] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.386094] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.386373] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.386516] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.386852] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.387279] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.387495] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.387772] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.387917] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.388078] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: b273769d-bb84-4057-857d-12c9941249fb is going to be created. [ 1238.408362] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.408636] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.408781] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.409080] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.409340] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.409574] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-b273769d-bb84-4057-857d-12c9941249fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.549286] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1238.549522] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.549716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.549939] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.550197] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.550323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.550400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.550561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.550643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.550728] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.550822] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.618812] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 1238.619270] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.056618] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.056618] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.056618] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.056618] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.056618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.057326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.057326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.057326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.057326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.057326] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.100162] env[69647]: INFO networking_nsxv3.common.synchronization [req-0a5ae142-b78f-4523-addb-f3a088b516e1 req-ea8141d8-2960-454e-89c5-ec9f78a9ffa7 service nova] Enqueued Resource ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d with Priority: HIGHEST for action security_group_rules [ 1239.100338] env[69647]: INFO networking_nsxv3.common.synchronization [req-0a5ae142-b78f-4523-addb-f3a088b516e1 req-ea8141d8-2960-454e-89c5-ec9f78a9ffa7 service nova] Enqueued Resource ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d with Priority: HIGHEST for action security_group_members [ 1239.100475] env[69647]: INFO networking_nsxv3.common.synchronization [req-0a5ae142-b78f-4523-addb-f3a088b516e1 req-ea8141d8-2960-454e-89c5-ec9f78a9ffa7 service nova] Enqueued Resource ID: b273769d-bb84-4057-857d-12c9941249fb with Priority: HIGHEST for action port [ 1239.101047] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d with Priority: HIGHEST for action security_group_rules [ 1239.101416] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d with Priority: HIGHEST for action security_group_members [ 1239.101551] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b273769d-bb84-4057-857d-12c9941249fb with Priority: HIGHEST for action port [ 1239.101871] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c8a8134-468e-45a8-a7ad-121c2c56d34d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.101990] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.102083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.102390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.102467] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c8a8134-468e-45a8-a7ad-121c2c56d34d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.103924] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c8a8134-468e-45a8-a7ad-121c2c56d34d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.104076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.104142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.104351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.104496] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.104589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.104665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.104849] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.104936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.105111] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c8a8134-468e-45a8-a7ad-121c2c56d34d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.105951] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b273769d-bb84-4057-857d-12c9941249fb taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.106084] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b273769d-bb84-4057-857d-12c9941249fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.106149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b273769d-bb84-4057-857d-12c9941249fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.106298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b273769d-bb84-4057-857d-12c9941249fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.106539] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b273769d-bb84-4057-857d-12c9941249fb',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.558739] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45cf2c25-d2a0-4c1d-8782-458368956d4a: rpc.has_security_group_logging(os_id): False [ 1239.575952] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.576308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.576378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.576601] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.576686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.576932] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.577090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.577150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.577328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.577408] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.577611] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.577709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.577770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.577914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.577983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.578186] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.578282] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.578341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.578481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.578569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.578642] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be created. [ 1239.607781] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c8a8134-468e-45a8-a7ad-121c2c56d34d taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.607946] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.609435] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c8a8134-468e-45a8-a7ad-121c2c56d34d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.610413] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b273769d-bb84-4057-857d-12c9941249fb with status ACTIVE [ 1239.610622] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.610778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.610837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.611019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.611116] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.611328] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.611472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.611543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.611698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.611775] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.611972] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.612098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.612163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.612261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.612330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.612411] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b273769d-bb84-4057-857d-12c9941249fb is going to be updated. [ 1239.631461] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.631944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.631944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.632050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.632190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.634156] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.634326] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.634415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.634613] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.634750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.634901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b273769d-bb84-4057-857d-12c9941249fb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.644462] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1240.115077] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c8a8134-468e-45a8-a7ad-121c2c56d34d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.617870] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.618110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.618110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.618351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.618461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.618569] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d is going to be created. [ 1240.642349] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.642883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.642883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.642883] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.643062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.652401] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d in Status: UNINITIALIZED for 2s [ 1241.660865] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1241.661244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.664029] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d in Status: SUCCESS [ 1242.664029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.664029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.664029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.664029] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.664029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.664029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.664532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.664532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.664532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.664532] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c8a8134-468e-45a8-a7ad-121c2c56d34d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.888363] env[69647]: INFO networking_nsxv3.common.synchronization [req-1b6e96f7-02f5-4218-acdc-df9567886534 req-0f355cfd-b4dc-49d0-980b-1cf0d3f13e78 tempest-ServersV294TestFqdnHostnames-399989070 tempest-ServersV294TestFqdnHostnames-399989070-project-member] Enqueued Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_members [ 1242.888673] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGHEST for action security_group_members [ 1242.889010] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6ff3703-4f0f-4e11-8846-e36203877107 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.889144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.889215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.889411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.889624] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.889717] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.889752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.889890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.889971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.890073] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.166583] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c8a8134-468e-45a8-a7ad-121c2c56d34d taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.166837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.166837] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.167083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.167247] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.167366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.167425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.167587] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.167670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.167757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.167904] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c8a8134-468e-45a8-a7ad-121c2c56d34d taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.168043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.168126] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.168254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.168536] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.168536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.168536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.168825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.168825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.168825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.168976] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c8a8134-468e-45a8-a7ad-121c2c56d34d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.392584] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.392813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.392932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.393256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.414976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.415237] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.415367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.415431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.415637] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.415732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.415835] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6ff3703-4f0f-4e11-8846-e36203877107 is going to be updated. [ 1243.449239] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.449412] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.449543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.449756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.451680] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.462080] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6ff3703-4f0f-4e11-8846-e36203877107 in Status: IN_PROGRESS for 2s [ 1243.671161] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c8a8134-468e-45a8-a7ad-121c2c56d34d: rpc.has_security_group_logging(os_id): False [ 1243.690045] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.690276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.690276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.690502] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.690573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.690805] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.690922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.690977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.691153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.691225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.691407] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.691497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.691570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.691691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.691766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.691943] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.692049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.692110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.692248] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.692318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.692404] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d is going to be created. [ 1243.745482] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.745720] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.745720] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.745968] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.746150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.763274] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d in Status: IN_PROGRESS for 2s [ 1245.471611] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6ff3703-4f0f-4e11-8846-e36203877107 in Status: SUCCESS [ 1245.471611] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6ff3703-4f0f-4e11-8846-e36203877107 deletion is rescheduled due to dependency. [ 1245.471611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.775790] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d in Status: SUCCESS [ 1245.776073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.890008] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1247.890333] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1250.462367] env[69647]: INFO networking_nsxv3.common.synchronization [None req-aa20db00-ac9c-441d-ae3e-c66f0b0eb3a8 None None] Enqueued Resource ID: d95d6443-e01a-4ebe-8af2-a4196d230614 with Priority: HIGHEST for action port [ 1250.462601] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d95d6443-e01a-4ebe-8af2-a4196d230614 with Priority: HIGHEST for action port [ 1250.464514] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-d95d6443-e01a-4ebe-8af2-a4196d230614 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.464514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d95d6443-e01a-4ebe-8af2-a4196d230614" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.464514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d95d6443-e01a-4ebe-8af2-a4196d230614" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.464514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d95d6443-e01a-4ebe-8af2-a4196d230614" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.464514] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d95d6443-e01a-4ebe-8af2-a4196d230614',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.968054] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d95d6443-e01a-4ebe-8af2-a4196d230614 [ 1250.968369] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.968488] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.968538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.968743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.968835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.969583] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d95d6443-e01a-4ebe-8af2-a4196d230614 already deleted. [ 1250.969583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d95d6443-e01a-4ebe-8af2-a4196d230614" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.518971] env[69647]: INFO networking_nsxv3.common.synchronization [req-f0a5bceb-2ee5-4be1-91e4-0f0b043670b3 req-19bd640d-6c74-49ad-bb63-ff8af3efc932 tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1251.520182] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1251.520378] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.520378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.520512] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.520788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.521020] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.521210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.521310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.521556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.521692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.521763] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.824500] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.824711] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.824839] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.825122] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.825382] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.825539] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.825658] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.825878] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.826070] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.826376] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1251.826498] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.826614] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.826724] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.826840] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1251.826949] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.827102] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.848260] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.848490] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1251.848653] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.848791] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.849128] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1058a9b2-84bc-41ee-9d9d-e72126d1a809 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.849307] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1058a9b2-84bc-41ee-9d9d-e72126d1a809" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.849431] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1058a9b2-84bc-41ee-9d9d-e72126d1a809" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.849760] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1058a9b2-84bc-41ee-9d9d-e72126d1a809" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.849898] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1058a9b2-84bc-41ee-9d9d-e72126d1a809',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.025435] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.069640] env[69647]: INFO networking_nsxv3.common.synchronization [req-8a070d90-cfe3-4314-bff9-df8d2b2e92ab req-5736a5fb-ac99-4591-8b48-eb7e57d8c00d tempest-ServerAddressesNegativeTestJSON-793100674 tempest-ServerAddressesNegativeTestJSON-793100674-project-member] Enqueued Resource ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d with Priority: HIGHEST for action security_group_members [ 1252.070167] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d with Priority: HIGHEST for action security_group_members [ 1252.071130] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c8a8134-468e-45a8-a7ad-121c2c56d34d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.071234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.071772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.071772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.071772] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.071772] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.071945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.071945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.072017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.072117] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c8a8134-468e-45a8-a7ad-121c2c56d34d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.354622] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.354907] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.354974] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.355279] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.355426] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.355583] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1058a9b2-84bc-41ee-9d9d-e72126d1a809 not found, creating... [ 1252.355841] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.356028] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.356177] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.356400] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.356547] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.356831] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.356991] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.357157] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.357366] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.357508] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.357649] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1058a9b2-84bc-41ee-9d9d-e72126d1a809 is going to be created. [ 1252.382422] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.382652] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.382777] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.383071] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.383312] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.383550] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1058a9b2-84bc-41ee-9d9d-e72126d1a809" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.528360] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.573796] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.574156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.574236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.574662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.574662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.574735] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.574943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.574943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.575083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.575152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.575410] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d is going to be updated. [ 1252.613646] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.613790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.613866] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.614112] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.614264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.618503] env[69647]: INFO networking_nsxv3.common.synchronization [req-adb4f7d6-d998-483a-afc8-651bfb47a9ca req-93d5285b-20f2-41fc-bb29-cac67d3cbb11 tempest-ServerActionsTestOtherB-626642147 tempest-ServerActionsTestOtherB-626642147-project-member] Enqueued Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1252.619213] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c35014e-8d95-4c20-872d-da537d220b20 with Priority: HIGHEST for action security_group_members [ 1252.619305] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c35014e-8d95-4c20-872d-da537d220b20 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.619383] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.619479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.619625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.619773] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.619871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.619933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.620087] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.620167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.620259] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c35014e-8d95-4c20-872d-da537d220b20',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.627375] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d in Status: IN_PROGRESS for 2s [ 1252.735951] env[69647]: INFO networking_nsxv3.common.synchronization [None req-b1a305d2-76c5-46c4-a2b8-435af5b9ee02 None None] Enqueued Resource ID: 3331b58e-360a-4ff7-abf3-88cbd4d0ce2c with Priority: HIGHEST for action port [ 1252.735951] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3331b58e-360a-4ff7-abf3-88cbd4d0ce2c with Priority: HIGHEST for action port [ 1252.736107] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-3331b58e-360a-4ff7-abf3-88cbd4d0ce2c taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.736251] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3331b58e-360a-4ff7-abf3-88cbd4d0ce2c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.736317] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3331b58e-360a-4ff7-abf3-88cbd4d0ce2c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.736630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3331b58e-360a-4ff7-abf3-88cbd4d0ce2c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.736689] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3331b58e-360a-4ff7-abf3-88cbd4d0ce2c',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.030660] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.030834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.032264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.032264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.032264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.032264] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1253.062733] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.062896] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.063019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.065311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.065311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.071608] env[69647]: INFO networking_nsxv3.common.synchronization [req-f0a5bceb-2ee5-4be1-91e4-0f0b043670b3 req-28a4ea2f-fae2-42d9-986f-14c821ee6c24 service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1253.071798] env[69647]: INFO networking_nsxv3.common.synchronization [req-f0a5bceb-2ee5-4be1-91e4-0f0b043670b3 req-28a4ea2f-fae2-42d9-986f-14c821ee6c24 service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1253.071947] env[69647]: INFO networking_nsxv3.common.synchronization [req-f0a5bceb-2ee5-4be1-91e4-0f0b043670b3 req-28a4ea2f-fae2-42d9-986f-14c821ee6c24 service nova] Enqueued Resource ID: 1058a9b2-84bc-41ee-9d9d-e72126d1a809 with Priority: HIGHEST for action port [ 1253.072777] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1253.072928] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1253.073442] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1253.073442] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1058a9b2-84bc-41ee-9d9d-e72126d1a809 with Priority: HIGHEST for action port [ 1253.073690] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.073838] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.073879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.074067] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.074151] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.074943] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.075200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.075361] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1058a9b2-84bc-41ee-9d9d-e72126d1a809 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.075361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1058a9b2-84bc-41ee-9d9d-e72126d1a809" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.075510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1058a9b2-84bc-41ee-9d9d-e72126d1a809" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.075569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1058a9b2-84bc-41ee-9d9d-e72126d1a809" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.075619] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1058a9b2-84bc-41ee-9d9d-e72126d1a809',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.123026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.123026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.123026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.123026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.123026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.123026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.123328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.123328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.123328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.123417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.123447] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 is going to be updated. [ 1253.154044] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.154044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.154044] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.154284] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.154429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.163345] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: IN_PROGRESS for 2s [ 1253.238436] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3331b58e-360a-4ff7-abf3-88cbd4d0ce2c [ 1253.238692] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.238826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.238895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.239120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.239212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.239323] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3331b58e-360a-4ff7-abf3-88cbd4d0ce2c already deleted. [ 1253.239432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3331b58e-360a-4ff7-abf3-88cbd4d0ce2c" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.577812] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.578132] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.580469] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1058a9b2-84bc-41ee-9d9d-e72126d1a809 with status ACTIVE [ 1253.580682] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.580682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.580790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.580916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.581107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.581215] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.581269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.581365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.581482] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.581559] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.581857] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.581857] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.581933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.582079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.582299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.582299] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1058a9b2-84bc-41ee-9d9d-e72126d1a809 is going to be updated. [ 1253.610878] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.611473] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.611544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.611757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.611899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.612060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1058a9b2-84bc-41ee-9d9d-e72126d1a809" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.636767] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d in Status: SUCCESS [ 1254.637049] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d deletion is rescheduled due to dependency. [ 1254.637049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.083303] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1255.083494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.083627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.083846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.084039] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.084178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.084239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.084403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.084484] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.084581] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.172600] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c35014e-8d95-4c20-872d-da537d220b20 in Status: SUCCESS [ 1255.172772] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c35014e-8d95-4c20-872d-da537d220b20 deletion is rescheduled due to dependency. [ 1255.172888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c35014e-8d95-4c20-872d-da537d220b20" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.587222] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.925741] env[69647]: INFO networking_nsxv3.common.synchronization [req-347026c5-f23e-4b8d-99b9-bf4a07436c8c req-876b53d6-7390-4dd5-9bbd-d5ec8058d435 tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1255.926429] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1255.926790] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.926914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.926980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.927345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.927533] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.927669] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.927747] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.927936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.928062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.928194] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.088999] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.182483] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.182694] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.182818] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.183169] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.183433] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.183594] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.183709] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.183926] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.184092] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.184329] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1256.184444] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1256.184553] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1256.184661] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1256.184770] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1256.184875] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1256.185013] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1256.202505] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1256.202671] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1256.202800] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1256.202964] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.203318] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-716d4aad-8b98-4a57-839b-23657b346443 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.203439] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-716d4aad-8b98-4a57-839b-23657b346443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.203552] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-716d4aad-8b98-4a57-839b-23657b346443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.203845] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-716d4aad-8b98-4a57-839b-23657b346443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.203984] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('716d4aad-8b98-4a57-839b-23657b346443',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.430132] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.430300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.430374] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.430596] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.430685] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.430877] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.431049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.431049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.431187] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.431262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.431357] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae already deleted. [ 1256.431458] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.592479] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.592635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.592706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.592926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.593027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.593129] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1256.627567] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.627709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.627754] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.627923] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.628076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.638537] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1256.705661] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.706842] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.706842] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.706842] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.706842] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.706842] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 716d4aad-8b98-4a57-839b-23657b346443 not found, creating... [ 1256.707123] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.707251] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.707408] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.707641] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.707746] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.708120] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.708217] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.708352] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.708566] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.709891] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.709891] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 716d4aad-8b98-4a57-839b-23657b346443 is going to be created. [ 1256.731062] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.731232] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.731361] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.731609] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.731824] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.732049] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-716d4aad-8b98-4a57-839b-23657b346443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.418259] env[69647]: INFO networking_nsxv3.common.synchronization [req-347026c5-f23e-4b8d-99b9-bf4a07436c8c req-aad5d097-9e58-47e7-a3b5-0d1e9b81fc60 service nova] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_rules [ 1257.418508] env[69647]: INFO networking_nsxv3.common.synchronization [req-347026c5-f23e-4b8d-99b9-bf4a07436c8c req-aad5d097-9e58-47e7-a3b5-0d1e9b81fc60 service nova] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1257.418580] env[69647]: INFO networking_nsxv3.common.synchronization [req-347026c5-f23e-4b8d-99b9-bf4a07436c8c req-aad5d097-9e58-47e7-a3b5-0d1e9b81fc60 service nova] Enqueued Resource ID: 716d4aad-8b98-4a57-839b-23657b346443 with Priority: HIGHEST for action port [ 1257.418806] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_rules [ 1257.418932] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1257.419037] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716d4aad-8b98-4a57-839b-23657b346443 with Priority: HIGHEST for action port [ 1257.419579] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.419704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.419852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.421191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.421383] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.422288] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.422439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.422529] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.422729] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.422948] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.423639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.423804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.424096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.424254] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.424417] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.425465] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-716d4aad-8b98-4a57-839b-23657b346443 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.425574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-716d4aad-8b98-4a57-839b-23657b346443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.425646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-716d4aad-8b98-4a57-839b-23657b346443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.425863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-716d4aad-8b98-4a57-839b-23657b346443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.426060] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('716d4aad-8b98-4a57-839b-23657b346443',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.932612] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.932804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.933144] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.934114] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 716d4aad-8b98-4a57-839b-23657b346443 with status ACTIVE [ 1257.934368] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.934538] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.934600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.936059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.936059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.936059] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.936059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.936059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.936059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.936059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.936059] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.936059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.936059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.936551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.936551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.936551] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 716d4aad-8b98-4a57-839b-23657b346443 is going to be updated. [ 1257.957379] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.957544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.957643] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.957873] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.958047] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.958267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-716d4aad-8b98-4a57-839b-23657b346443" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.438810] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.648446] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1258.648682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.648945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.649071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.649263] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.649432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.649432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.649584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.649770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.649770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.649872] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.941734] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.941988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.942137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.942430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.942727] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.942830] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be created. [ 1258.966522] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.966704] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.966748] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.966921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.967089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.976779] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: UNINITIALIZED for 2s [ 1259.152006] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.152169] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.152233] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.152438] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.152597] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.152693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.152754] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.152895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.152981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.153081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.153228] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.153348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.153414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.153556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.153700] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.153795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.153834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.153969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.154054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.154147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.154278] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.657053] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45cf2c25-d2a0-4c1d-8782-458368956d4a: rpc.has_security_group_logging(os_id): False [ 1259.683308] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.683308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.683308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.683308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.683621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.683862] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.683989] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.684057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.684207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.684276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.684489] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.684586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.684646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.684787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.684856] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.685044] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.685134] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.685189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.685314] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.685396] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.685477] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1259.759845] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.760072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.760072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.760228] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.760372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.772409] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1260.986347] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1260.986647] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.986731] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.987423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.987423] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.987423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.987423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.987759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.987759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.987759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.987759] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.490637] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.490824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.490824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.491061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.491231] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.491334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.491399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.491550] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.491635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.491724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.491865] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.491955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.492025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.492165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.492298] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.492387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.492446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.492576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.492648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.492725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.492812] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.784703] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1261.785017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.995881] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02b693ca-6a80-4111-bfc9-073a1484feae: rpc.has_security_group_logging(os_id): False [ 1262.014716] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.014906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.014980] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.015264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.015363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.015641] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.015778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.015862] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.016098] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.016173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.016442] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.016566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.016640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.016830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.016912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.017122] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.017250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.017347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.017504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.017609] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.017729] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be created. [ 1262.077144] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.077315] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.077381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.077590] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.077770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.088379] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1262.419539] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.419637] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1263.254256] env[69647]: INFO networking_nsxv3.common.synchronization [req-827772c5-ed71-490c-9154-578ded75f602 req-9424fcb5-d0c2-4e61-96f0-b8b52e649314 tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1263.254256] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1263.254256] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.254256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.254256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.254256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.254256] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.254256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.254256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.254256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.254256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.254256] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.758190] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.101421] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1264.101677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.260811] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.763153] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.763300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.763393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.763586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.763678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.763778] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1264.790315] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.790459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.790567] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.790758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.790876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.801822] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1266.813445] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1266.813683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.255879] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1268.256215] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1272.202996] env[69647]: INFO networking_nsxv3.common.synchronization [req-2dd9d576-4e68-41b2-88e6-48435269c53b req-8a3bcc8f-8ff0-4fee-9952-3854ea10e6d4 tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1272.203527] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1272.203822] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.203940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.204011] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.204219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.204377] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.204489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.204544] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.206821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.206821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.206821] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.436277] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.436559] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.436695] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.436963] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.437242] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.437422] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.437576] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.437788] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.437931] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.438162] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1272.438279] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1272.438392] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1272.438781] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1272.438781] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1272.438781] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1272.438985] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1272.460441] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1272.460598] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1272.460726] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1272.460897] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.461217] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-a85ca3ce-fc80-417e-8c58-e12ec4598799 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.462029] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-a85ca3ce-fc80-417e-8c58-e12ec4598799" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.462029] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-a85ca3ce-fc80-417e-8c58-e12ec4598799" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.462029] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-a85ca3ce-fc80-417e-8c58-e12ec4598799" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.462029] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a85ca3ce-fc80-417e-8c58-e12ec4598799',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.707413] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.965269] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.965564] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.965644] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.965955] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.966115] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.966276] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port a85ca3ce-fc80-417e-8c58-e12ec4598799 not found, creating... [ 1272.966576] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.966771] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.966843] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.967155] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.967304] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.967618] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.967784] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.967900] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.968335] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.968335] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.968426] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: a85ca3ce-fc80-417e-8c58-e12ec4598799 is going to be created. [ 1272.988878] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.988975] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.989122] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.989367] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.989608] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.990521] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-a85ca3ce-fc80-417e-8c58-e12ec4598799" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.209808] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.681762] env[69647]: INFO networking_nsxv3.common.synchronization [req-2dd9d576-4e68-41b2-88e6-48435269c53b req-cd0ea22d-acb6-47b0-899b-d607733ebced service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1273.682047] env[69647]: INFO networking_nsxv3.common.synchronization [req-2dd9d576-4e68-41b2-88e6-48435269c53b req-cd0ea22d-acb6-47b0-899b-d607733ebced service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1273.682376] env[69647]: INFO networking_nsxv3.common.synchronization [req-2dd9d576-4e68-41b2-88e6-48435269c53b req-cd0ea22d-acb6-47b0-899b-d607733ebced service nova] Enqueued Resource ID: a85ca3ce-fc80-417e-8c58-e12ec4598799 with Priority: HIGHEST for action port [ 1273.682657] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1273.682814] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1273.682882] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a85ca3ce-fc80-417e-8c58-e12ec4598799 with Priority: HIGHEST for action port [ 1273.683908] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.684072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.684147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.684401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.684473] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.685515] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.685515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.685743] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-a85ca3ce-fc80-417e-8c58-e12ec4598799 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.685852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a85ca3ce-fc80-417e-8c58-e12ec4598799" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.685935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a85ca3ce-fc80-417e-8c58-e12ec4598799" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.686105] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a85ca3ce-fc80-417e-8c58-e12ec4598799" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.686173] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a85ca3ce-fc80-417e-8c58-e12ec4598799',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.712690] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.712895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.712895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.713118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.713210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.713311] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1273.745803] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.746055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.746055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.746245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.746379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.756272] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1274.188794] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.188794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.188794] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a85ca3ce-fc80-417e-8c58-e12ec4598799 with status ACTIVE [ 1274.188794] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.189191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.189191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.189191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.189290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.189532] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.189532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.189691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.189691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.189907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.189967] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.190045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.190096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.190210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.190272] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.190362] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a85ca3ce-fc80-417e-8c58-e12ec4598799 is going to be updated. [ 1274.209785] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.209916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.210164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.210164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.210396] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.210396] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a85ca3ce-fc80-417e-8c58-e12ec4598799" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.765815] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1275.766169] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.766236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.766460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.766670] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.766782] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.766843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.767025] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.767118] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.767226] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.270473] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.482875] env[69647]: INFO networking_nsxv3.common.synchronization [req-8b4ca9bc-18c5-4c05-9c5c-80a2c8f2fcd9 req-17bc69e8-6f30-475e-b77b-03507dcaf355 tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1276.483442] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1276.483770] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.483892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.483958] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.484301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.484736] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.484736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.484736] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.484901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.484901] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.484969] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.773190] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.987149] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.987363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.987416] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.987633] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.987750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.987953] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.988071] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.988133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.988407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.988451] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.988526] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1277.020294] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.020466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.020527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.020705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.020846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.029560] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1277.275806] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.275970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.276058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.276410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.276534] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.276643] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1277.306171] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.306339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.306385] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.306619] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.306766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.315604] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1279.038634] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1279.038968] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae deletion is rescheduled due to dependency. [ 1279.039023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.141048] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ea7a1da-91e8-47d3-a226-4cd594bb7c3b req-cdbe619b-5960-4250-9855-85728ec00fbb tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1279.141808] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1279.141987] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.142168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.142221] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.142377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.142524] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.142621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.142683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.142820] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.142902] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.142990] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.326267] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1279.326267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.326267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.326267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.326267] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.326267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.326267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.326267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.326267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.326708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.326708] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.383188] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.383331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.383427] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.383702] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.383961] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.384132] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.384252] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.384475] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.384617] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.384850] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.384977] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1279.385090] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1279.385202] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1279.385316] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.385424] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1279.385561] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1279.403542] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1279.403719] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1279.403957] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1279.404170] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.404486] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-fbe33a77-fee9-4f72-84cf-b5ba19ab879d taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.404662] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-fbe33a77-fee9-4f72-84cf-b5ba19ab879d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.404790] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-fbe33a77-fee9-4f72-84cf-b5ba19ab879d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.405093] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-fbe33a77-fee9-4f72-84cf-b5ba19ab879d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.405237] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbe33a77-fee9-4f72-84cf-b5ba19ab879d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.645111] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.645288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.645345] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.645549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.645640] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.645833] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.645929] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.645992] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.646191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.646246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.646310] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1279.673540] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.673686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.673738] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.673937] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.674086] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.682378] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1279.832121] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.832259] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.832307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.832520] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.832692] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.832796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.832852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.833045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.833119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.833172] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.833320] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.833411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.833469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.833630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.833780] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.833911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.833911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.833998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.834114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.834167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.834262] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.907184] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.907541] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.907635] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.907859] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.908021] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.908183] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port fbe33a77-fee9-4f72-84cf-b5ba19ab879d not found, creating... [ 1279.908443] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.908605] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.908726] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.908949] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.909100] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.909382] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.909540] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.909953] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.909953] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.910071] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.910138] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: fbe33a77-fee9-4f72-84cf-b5ba19ab879d is going to be created. [ 1279.930327] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.930594] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.930757] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.931077] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.931355] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.931594] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-fbe33a77-fee9-4f72-84cf-b5ba19ab879d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.337644] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45cf2c25-d2a0-4c1d-8782-458368956d4a: rpc.has_security_group_logging(os_id): False [ 1280.374788] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.374954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.375027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.375238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.375327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.375535] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.375634] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.375696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.375839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.375915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.376123] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.376219] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.376280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.376418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.376586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.376704] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.376790] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.376842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.376986] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.377072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.377156] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1280.437373] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.437531] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.437594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.437773] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.437920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.450678] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1280.602471] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ea7a1da-91e8-47d3-a226-4cd594bb7c3b req-a2b4da9d-8248-4937-aa21-4c5d50bc2d4a service nova] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_rules [ 1280.602471] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ea7a1da-91e8-47d3-a226-4cd594bb7c3b req-a2b4da9d-8248-4937-aa21-4c5d50bc2d4a service nova] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1280.602471] env[69647]: INFO networking_nsxv3.common.synchronization [req-0ea7a1da-91e8-47d3-a226-4cd594bb7c3b req-a2b4da9d-8248-4937-aa21-4c5d50bc2d4a service nova] Enqueued Resource ID: fbe33a77-fee9-4f72-84cf-b5ba19ab879d with Priority: HIGHEST for action port [ 1280.602471] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_rules [ 1280.602471] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1280.602471] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe33a77-fee9-4f72-84cf-b5ba19ab879d with Priority: HIGHEST for action port [ 1280.603267] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.603653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.603842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.604578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.604578] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.605153] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.605153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.605334] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbe33a77-fee9-4f72-84cf-b5ba19ab879d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.605426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbe33a77-fee9-4f72-84cf-b5ba19ab879d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.605490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbe33a77-fee9-4f72-84cf-b5ba19ab879d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.605910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbe33a77-fee9-4f72-84cf-b5ba19ab879d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.605910] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbe33a77-fee9-4f72-84cf-b5ba19ab879d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.107910] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.108188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.108492] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbe33a77-fee9-4f72-84cf-b5ba19ab879d with status ACTIVE [ 1281.108747] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.108903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.108996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.109313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.109442] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.109702] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.109835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.109944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.110207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.110382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.110692] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.110842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.110959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.111200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.111287] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.111424] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbe33a77-fee9-4f72-84cf-b5ba19ab879d is going to be updated. [ 1281.135427] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.135659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.135659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.135875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.136019] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.136195] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbe33a77-fee9-4f72-84cf-b5ba19ab879d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.695904] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1281.696269] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae deletion is rescheduled due to dependency. [ 1281.696269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.696468] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.696732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.696944] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.697073] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.697138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.697361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.697473] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.697595] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.200041] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.427521] env[69647]: INFO networking_nsxv3.common.synchronization [req-5dfe73e7-f36e-4d48-aac4-4be40ceb57ac req-c0e4db05-0880-4d2b-bdd1-89c1016526d8 tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_members [ 1282.428079] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGHEST for action security_group_members [ 1282.428382] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-54be61ed-09b8-4c7e-8b2a-07214a54018b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.428524] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.428575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.428755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.429459] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.429459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.429459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.429459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.429459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.429664] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54be61ed-09b8-4c7e-8b2a-07214a54018b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.465841] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1282.466069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.705760] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.931865] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.932069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.932119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.932339] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.932431] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.932629] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.932730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.932793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.932938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.933029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.933112] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b is going to be updated. [ 1282.962245] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.962407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.962451] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.962585] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.962717] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.970738] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b in Status: IN_PROGRESS for 2s [ 1283.209061] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.209235] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.209307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.209514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.209604] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.209704] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1283.239929] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.240083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.240147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.240354] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.240496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.248932] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1284.517807] env[69647]: INFO networking_nsxv3.common.synchronization [req-2bcde1bf-c48a-4a0b-9f99-f68222233636 req-d5d2431e-513f-4f0b-b456-f6e222c0fa0b tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1284.518177] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1284.518495] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.518629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.518696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.518925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.519081] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.519177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.519250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.519399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.519474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.519565] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.979698] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b in Status: SUCCESS [ 1284.980164] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b deletion is rescheduled due to dependency. [ 1284.980290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.021780] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.241467] env[69647]: INFO networking_nsxv3.common.synchronization [req-7335fdf3-f931-47b4-a4a2-dd2ef5308928 req-962d3edf-4948-42f2-b18d-b7e9217886fe tempest-ServerActionsTestJSON-959062572 tempest-ServerActionsTestJSON-959062572-project-member] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1285.241970] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGHEST for action security_group_members [ 1285.243014] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.243014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.243014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.243014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.243014] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.243014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.243014] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.243358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.243358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.243424] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.284369] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1285.284608] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.284770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.284981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.285181] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.285290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.285351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.285499] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.285575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.285665] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.285753] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.523771] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.745682] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.745879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.745938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.746257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.746381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.746669] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.746821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.746821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.747058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.747165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.747277] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be updated. [ 1285.783740] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.783932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.783932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.784253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.784456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.788104] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.788278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.788278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.788444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.788617] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.788715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.788715] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.788852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.788931] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.789017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.789158] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.789246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.789298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.789432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.789566] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.789656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.789703] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.789848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.789982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.790056] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.790100] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.792949] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: IN_PROGRESS for 2s [ 1286.026258] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.026461] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.026522] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.026751] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.026844] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.026951] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1286.067626] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.067626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.067626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.067848] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.067879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.076788] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1286.292315] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02b693ca-6a80-4111-bfc9-073a1484feae: rpc.has_security_group_logging(os_id): False [ 1286.311077] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.311255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.311296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.311477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.311566] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.311774] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.311870] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.311938] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.312089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.312164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.312338] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.312422] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.312479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.312616] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.312688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.312872] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.312961] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.313026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.313167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.313239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.313322] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1286.381097] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.381097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.381097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.381097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.381097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.399682] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1287.802512] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efccc372-9e22-4eea-9577-4fd80da780f3 in Status: SUCCESS [ 1287.802890] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 deletion is rescheduled due to dependency. [ 1287.802890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.088539] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1288.088809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.413871] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1288.414106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.243528] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.243909] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1293.376517] env[69647]: INFO networking_nsxv3.common.synchronization [req-69ae9985-8a49-42fa-81eb-489e769ba687 req-55deb845-b755-4d9a-a8cd-7b0c06b40394 tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1293.377096] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1293.378916] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.381208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.381288] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.381515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.381684] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.381792] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.381851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.382015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.382105] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.382203] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.696725] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.696949] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.697092] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.698171] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.698171] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.698171] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.698171] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.698171] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.698551] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.698551] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1293.698551] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1293.698651] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1293.698767] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1293.698882] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1293.699038] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1293.699202] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1293.719986] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1293.720179] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1293.720318] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1293.720486] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.720792] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-393cd77b-4161-4663-90af-7b98f7e6978b taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.721642] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.721642] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.721642] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.721642] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('393cd77b-4161-4663-90af-7b98f7e6978b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.888792] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.889050] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.889169] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.889694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.889694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.889798] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.889885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.891030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.891030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.891030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.891030] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc is going to be updated. [ 1293.922534] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.922684] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.922758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.922970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.923110] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.933059] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: IN_PROGRESS for 2s [ 1294.224066] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.224357] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.224454] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.224811] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.224896] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.225064] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 393cd77b-4161-4663-90af-7b98f7e6978b not found, creating... [ 1294.225453] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.225536] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.225614] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.225912] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.226105] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.226455] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.226721] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.226870] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.227101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.227245] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.227388] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 393cd77b-4161-4663-90af-7b98f7e6978b is going to be created. [ 1294.256381] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.256685] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.256893] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.257271] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.257581] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.257893] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.951899] env[69647]: INFO networking_nsxv3.common.synchronization [req-69ae9985-8a49-42fa-81eb-489e769ba687 req-00d571bf-0502-423b-b2ba-59287ec28629 service nova] Enqueued Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_rules [ 1294.952160] env[69647]: INFO networking_nsxv3.common.synchronization [req-69ae9985-8a49-42fa-81eb-489e769ba687 req-00d571bf-0502-423b-b2ba-59287ec28629 service nova] Enqueued Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1294.952249] env[69647]: INFO networking_nsxv3.common.synchronization [req-69ae9985-8a49-42fa-81eb-489e769ba687 req-00d571bf-0502-423b-b2ba-59287ec28629 service nova] Enqueued Resource ID: 393cd77b-4161-4663-90af-7b98f7e6978b with Priority: HIGHEST for action port [ 1294.952416] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_rules [ 1294.952547] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1294.952648] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393cd77b-4161-4663-90af-7b98f7e6978b with Priority: HIGHEST for action port [ 1294.953239] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.953365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.953439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.953641] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.953731] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.954596] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.954694] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.954889] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-393cd77b-4161-4663-90af-7b98f7e6978b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.954988] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.955063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.955226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.955300] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('393cd77b-4161-4663-90af-7b98f7e6978b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.457050] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.457190] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.457297] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 393cd77b-4161-4663-90af-7b98f7e6978b with status ACTIVE [ 1295.457459] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.457571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.457646] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.457846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.457933] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.458119] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.458214] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.458273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.458416] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.458490] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.458663] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.458755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.458817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.458952] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.459034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.459117] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 393cd77b-4161-4663-90af-7b98f7e6978b is going to be updated. [ 1295.480854] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.481507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.481507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.481507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.481507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.481661] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.539181] env[69647]: INFO networking_nsxv3.common.synchronization [req-b0219b77-200c-4fd1-8338-2004e8c98ee2 req-3a694d0b-8d32-4055-a51d-95537f9aed27 tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1295.539667] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1295.539962] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.540096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.540162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.540351] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.540499] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.540594] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.540653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.540796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.540886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.540977] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.817070] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.817285] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.817489] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.817681] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.817949] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.818120] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.818238] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.818458] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.818596] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.818803] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1295.818915] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1295.819036] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1295.819146] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1295.819258] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1295.819365] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1295.819496] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1295.838873] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1295.839042] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1295.839180] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1295.839340] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.839612] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-8ae57f3d-7994-4ca2-b2e9-882c08941664 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.839772] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-8ae57f3d-7994-4ca2-b2e9-882c08941664" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.839895] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-8ae57f3d-7994-4ca2-b2e9-882c08941664" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.840221] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-8ae57f3d-7994-4ca2-b2e9-882c08941664" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.840361] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ae57f3d-7994-4ca2-b2e9-882c08941664',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.941934] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: SUCCESS [ 1295.942125] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc deletion is rescheduled due to dependency. [ 1295.942232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.942372] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.942576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.942753] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.942896] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.942991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.943165] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.943246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.943346] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.042561] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.343045] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.343303] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.343479] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.343725] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.343881] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.344056] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 8ae57f3d-7994-4ca2-b2e9-882c08941664 not found, creating... [ 1296.344342] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.344495] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.344777] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.345081] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.345236] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.345534] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.345698] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.345821] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.346055] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.346199] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.346343] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 8ae57f3d-7994-4ca2-b2e9-882c08941664 is going to be created. [ 1296.366327] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.366509] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.366632] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.366944] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.367188] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.367410] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-8ae57f3d-7994-4ca2-b2e9-882c08941664" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.445196] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.544582] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.947345] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.046892] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.047229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.047229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.047347] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.047439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.047538] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1297.066169] env[69647]: INFO networking_nsxv3.common.synchronization [req-b0219b77-200c-4fd1-8338-2004e8c98ee2 req-6741957e-967c-4ca1-b8e1-e59c408c4016 service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1297.066355] env[69647]: INFO networking_nsxv3.common.synchronization [req-b0219b77-200c-4fd1-8338-2004e8c98ee2 req-6741957e-967c-4ca1-b8e1-e59c408c4016 service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1297.066496] env[69647]: INFO networking_nsxv3.common.synchronization [req-b0219b77-200c-4fd1-8338-2004e8c98ee2 req-6741957e-967c-4ca1-b8e1-e59c408c4016 service nova] Enqueued Resource ID: 8ae57f3d-7994-4ca2-b2e9-882c08941664 with Priority: HIGHEST for action port [ 1297.067746] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1297.067888] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1297.068110] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae57f3d-7994-4ca2-b2e9-882c08941664 with Priority: HIGHEST for action port [ 1297.068277] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.068398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.068465] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.068659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.068738] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.069583] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.069712] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.069920] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ae57f3d-7994-4ca2-b2e9-882c08941664 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.070037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ae57f3d-7994-4ca2-b2e9-882c08941664" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.070106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ae57f3d-7994-4ca2-b2e9-882c08941664" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.070278] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ae57f3d-7994-4ca2-b2e9-882c08941664" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.070355] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ae57f3d-7994-4ca2-b2e9-882c08941664',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.080093] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.080401] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.080606] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.080979] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.081192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.092211] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1297.450196] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.450367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.450367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.450584] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.450675] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.450774] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc is going to be updated. [ 1297.480737] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.480885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.480990] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.481265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.481445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.490340] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: IN_PROGRESS for 2s [ 1297.572970] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.573133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.573311] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ae57f3d-7994-4ca2-b2e9-882c08941664 with status ACTIVE [ 1297.573478] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.573583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.573649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.573869] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.573943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.574124] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.574229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.574307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.574411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.574489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.574706] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.574811] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.574871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.575023] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.575101] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.575183] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ae57f3d-7994-4ca2-b2e9-882c08941664 is going to be updated. [ 1297.597530] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.597709] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.597794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.597950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.598099] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.598258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ae57f3d-7994-4ca2-b2e9-882c08941664" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.101453] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 4s [ 1299.500727] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: SUCCESS [ 1299.500952] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.501164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.501387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.501582] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.501696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.501764] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.501921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.501999] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.502429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.502429] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.004992] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.006328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.006328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.006328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.006328] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.006328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.006328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.006328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.006328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.006328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.006903] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.006903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.006903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.006903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.006903] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.007211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.007211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.007211] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.007357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.007357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.007474] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.509968] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab38e957-a1f6-4899-8baa-e3b1e3516ffc: rpc.has_security_group_logging(os_id): False [ 1300.530646] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.530843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.530843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.531064] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.531155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.531373] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.531472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.531531] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.531681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.531758] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.531940] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.532039] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.532101] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.532238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.532310] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.532481] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.532564] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.532622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.532756] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.532832] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.532918] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc is going to be updated. [ 1300.597143] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.597350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.597350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.597557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.597708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.613726] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: IN_PROGRESS for 2s [ 1301.111082] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1301.111082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.111082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.111368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.111579] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.111781] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.111889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.112106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.112220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.112324] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.614235] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.834841] env[69647]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1301.834978] env[69647]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-d1cae01e-4227-47d5-ae3e-4a97bb1c3693 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1302.068878] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1302.069101] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1302.080245] env[69647]: INFO networking_nsxv3.common.synchronization [req-401f7cd6-ee94-4a9d-b338-84f1fb8c87b4 req-89e5f93c-e871-4b3c-8c0f-8fe14e37cb46 tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1302.080245] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1302.080245] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.080245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.080245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.080458] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.080593] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.080668] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.080732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.080875] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.080958] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.081177] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.115918] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.583952] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.584168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.584250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.584532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.584666] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.584966] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.585146] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.585238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.585430] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.585531] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.585646] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1302.617927] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.618358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.618358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.618358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.618467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.618502] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1302.622481] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.622629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.622677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.622824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.622956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.639076] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: SUCCESS [ 1302.639280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.639611] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1302.665691] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.665871] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.665943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.666217] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.666382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.675270] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1304.400911] env[69647]: INFO networking_nsxv3.common.synchronization [req-09896329-6ddd-4a38-a586-c1c641ef45f8 req-69596e80-c2f8-41ed-91ad-5e63f56ab850 tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1304.401634] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGHEST for action security_group_members [ 1304.401880] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.402676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.402676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.402676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.402805] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.402862] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.402899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.403036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.403125] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.403219] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.458689] env[69647]: INFO networking_nsxv3.common.synchronization [req-09896329-6ddd-4a38-a586-c1c641ef45f8 req-69596e80-c2f8-41ed-91ad-5e63f56ab850 tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: 393cd77b-4161-4663-90af-7b98f7e6978b with Priority: HIGHEST for action port [ 1304.459193] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393cd77b-4161-4663-90af-7b98f7e6978b with Priority: HIGHEST for action port [ 1304.459504] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-393cd77b-4161-4663-90af-7b98f7e6978b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.459624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.459692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.459885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.459967] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('393cd77b-4161-4663-90af-7b98f7e6978b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.649095] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1304.649261] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae deletion is rescheduled due to dependency. [ 1304.649377] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.686154] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1304.686154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.686154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.686154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.686320] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.686320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.686419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.686525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.686605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.686690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.686816] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.905101] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.905368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.905368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.905524] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.905679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.905813] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.905906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.905969] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.906133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.906212] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.906300] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc is going to be updated. [ 1304.933041] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.933041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.933041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.933041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.933041] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.937038] env[69647]: INFO networking_nsxv3.common.synchronization [req-d8f52c73-96c0-41f1-bb1f-7c95c988379f req-a3ecc7b0-389c-41de-889d-99c4cf4ec897 tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1304.937240] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1304.937554] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.937670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.937737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.937966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.938146] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.938243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.938304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.938455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.938546] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.938638] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.941589] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: IN_PROGRESS for 2s [ 1304.961629] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 393cd77b-4161-4663-90af-7b98f7e6978b with status ACTIVE [ 1304.961764] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.961842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.961957] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.962316] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.962541] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.962738] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.962843] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.962907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.963082] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.963178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.963370] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.963453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.963511] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.965290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.965290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.965290] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 393cd77b-4161-4663-90af-7b98f7e6978b is going to be updated. [ 1304.984856] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.985017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.985122] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.985321] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.985456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.985612] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-393cd77b-4161-4663-90af-7b98f7e6978b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.190543] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.190898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.190898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.191053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.191241] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.191340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.191407] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.192090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.192210] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.192307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.192478] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.192779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.192779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.192893] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.192951] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.193063] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.193127] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.193300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.193399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.193508] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.193600] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.203534] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.203534] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.204091] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.204091] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.204416] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.204588] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.204721] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.206430] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.207016] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.207566] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1305.208066] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1305.208211] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1305.208342] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1305.208465] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1305.208669] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1305.208825] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1305.237550] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1305.237797] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1305.238454] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1305.238728] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.238996] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-062f913c-8078-4769-9c07-1bbcda5ed503 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.239203] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-062f913c-8078-4769-9c07-1bbcda5ed503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.239325] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-062f913c-8078-4769-9c07-1bbcda5ed503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.239642] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-062f913c-8078-4769-9c07-1bbcda5ed503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.239826] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('062f913c-8078-4769-9c07-1bbcda5ed503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.442053] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.442053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.442053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.442053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.442053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.442053] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.442053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.442053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.442053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.442053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.442053] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1305.470976] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.471156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.471225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.471475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.471626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.482989] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1305.697248] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45cf2c25-d2a0-4c1d-8782-458368956d4a: rpc.has_security_group_logging(os_id): False [ 1305.719026] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.719281] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.719281] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.719498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.719586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.719808] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.719907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.719970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.720133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.720234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.720395] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.720552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.720622] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.720769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.720846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.721040] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.721136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.721193] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.721334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.721411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.721494] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1305.742896] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.743145] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.743368] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.743602] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.743752] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.743913] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 062f913c-8078-4769-9c07-1bbcda5ed503 not found, creating... [ 1305.744194] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.744354] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.744473] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.744686] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.744824] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.745122] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.745280] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.745397] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.745603] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.745735] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.745920] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 062f913c-8078-4769-9c07-1bbcda5ed503 is going to be created. [ 1305.766101] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.766101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.766101] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.766439] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.766534] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.766828] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-062f913c-8078-4769-9c07-1bbcda5ed503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.783138] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.783314] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.783358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.783581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.783755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.803889] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1306.440047] env[69647]: INFO networking_nsxv3.common.synchronization [req-d8f52c73-96c0-41f1-bb1f-7c95c988379f req-7a1bce51-8f8a-4327-becd-dad5513a90a7 service nova] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_rules [ 1306.440047] env[69647]: INFO networking_nsxv3.common.synchronization [req-d8f52c73-96c0-41f1-bb1f-7c95c988379f req-7a1bce51-8f8a-4327-becd-dad5513a90a7 service nova] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1306.440317] env[69647]: INFO networking_nsxv3.common.synchronization [req-d8f52c73-96c0-41f1-bb1f-7c95c988379f req-7a1bce51-8f8a-4327-becd-dad5513a90a7 service nova] Enqueued Resource ID: 062f913c-8078-4769-9c07-1bbcda5ed503 with Priority: HIGHEST for action port [ 1306.440488] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_rules [ 1306.440642] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1306.440764] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062f913c-8078-4769-9c07-1bbcda5ed503 with Priority: HIGHEST for action port [ 1306.441488] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.441583] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.441655] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.441882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.441981] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.442822] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.443088] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.443185] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-062f913c-8078-4769-9c07-1bbcda5ed503 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.443299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-062f913c-8078-4769-9c07-1bbcda5ed503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.443369] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-062f913c-8078-4769-9c07-1bbcda5ed503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.443588] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-062f913c-8078-4769-9c07-1bbcda5ed503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.443637] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('062f913c-8078-4769-9c07-1bbcda5ed503',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.944957] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.945199] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.945279] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 062f913c-8078-4769-9c07-1bbcda5ed503 with status ACTIVE [ 1306.945445] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.945551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.945617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.945823] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.945912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.946098] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.946220] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.946256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.946398] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.946477] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.946644] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.946776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.946854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.947097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.947174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.947258] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 062f913c-8078-4769-9c07-1bbcda5ed503 is going to be updated. [ 1306.953965] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc in Status: SUCCESS [ 1306.954165] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc deletion is rescheduled due to dependency. [ 1306.954264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.975912] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.976092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.976092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.976280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.976403] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.976551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-062f913c-8078-4769-9c07-1bbcda5ed503" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.491994] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1307.492252] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae deletion is rescheduled due to dependency. [ 1307.492330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.492453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.492662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.492839] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.492959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.493040] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.493189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.493267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.493365] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.820282] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1307.820532] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.995510] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.498853] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.000367] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.000549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.000595] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.000795] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.000886] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.000987] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1309.032440] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.032645] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.032693] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.032895] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.033054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.040678] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1309.316413] env[69647]: INFO networking_nsxv3.common.synchronization [req-c47467f5-3ba5-4e14-972e-43b899a310ad req-f33c7f58-8233-440f-8ea4-5fc0bd928fc9 tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1309.317032] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1309.317645] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.317854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.317918] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.318149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.318341] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.318467] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.318562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.318743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.318865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.318967] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.600450] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.600815] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.600815] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.601075] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.601357] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.601514] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.601632] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.601871] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.602025] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.602244] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1309.602361] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1309.602486] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1309.602596] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1309.602709] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1309.602815] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1309.602951] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1309.620087] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1309.620244] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1309.620384] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1309.620550] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.620824] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-7661d905-1f7a-4769-9781-71c9858f46de taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.620989] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-7661d905-1f7a-4769-9781-71c9858f46de" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.621130] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-7661d905-1f7a-4769-9781-71c9858f46de" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.621423] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-7661d905-1f7a-4769-9781-71c9858f46de" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.621560] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7661d905-1f7a-4769-9781-71c9858f46de',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.820959] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.123959] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.124258] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.124432] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.124764] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.124960] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.125162] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 7661d905-1f7a-4769-9781-71c9858f46de not found, creating... [ 1310.125460] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.125663] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.125828] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.126120] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.126303] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.126617] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.126856] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.127094] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.127345] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.127546] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.127700] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 7661d905-1f7a-4769-9781-71c9858f46de is going to be created. [ 1310.147295] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.147469] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.147584] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.147819] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.148049] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.148358] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-7661d905-1f7a-4769-9781-71c9858f46de" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.322768] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.825620] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.826036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.826036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.826209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.826266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.826316] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1310.866376] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.866722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.866722] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.866944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.867229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.879517] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1310.913065] env[69647]: INFO networking_nsxv3.common.synchronization [req-c47467f5-3ba5-4e14-972e-43b899a310ad req-88f7490d-97b4-4aec-baf9-5f994e59a735 service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1310.913312] env[69647]: INFO networking_nsxv3.common.synchronization [req-c47467f5-3ba5-4e14-972e-43b899a310ad req-88f7490d-97b4-4aec-baf9-5f994e59a735 service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1310.913415] env[69647]: INFO networking_nsxv3.common.synchronization [req-c47467f5-3ba5-4e14-972e-43b899a310ad req-88f7490d-97b4-4aec-baf9-5f994e59a735 service nova] Enqueued Resource ID: 7661d905-1f7a-4769-9781-71c9858f46de with Priority: HIGHEST for action port [ 1310.914251] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1310.914251] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1310.914415] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7661d905-1f7a-4769-9781-71c9858f46de with Priority: HIGHEST for action port [ 1310.914978] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.915157] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.915226] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.915474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.915555] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.916961] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.917836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.918117] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-7661d905-1f7a-4769-9781-71c9858f46de taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.918261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7661d905-1f7a-4769-9781-71c9858f46de" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.918346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7661d905-1f7a-4769-9781-71c9858f46de" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.918739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7661d905-1f7a-4769-9781-71c9858f46de" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.918861] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7661d905-1f7a-4769-9781-71c9858f46de',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.052910] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1311.053186] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.053384] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.053649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.053905] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.054053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.054124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.054294] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.054382] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.054495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.054605] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.421090] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.421275] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.421593] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7661d905-1f7a-4769-9781-71c9858f46de with status ACTIVE [ 1311.421737] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.421865] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.421983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.422243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.422334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.422531] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.422627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.422686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.422842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.422970] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.423124] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.423231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.423290] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.423426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.423498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.423584] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7661d905-1f7a-4769-9781-71c9858f46de is going to be updated. [ 1311.447299] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.447392] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.447470] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.447674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.447786] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.447964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7661d905-1f7a-4769-9781-71c9858f46de" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.556897] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.557129] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.557189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.557361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.557520] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.557617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.557681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.557825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.557954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.558097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.558160] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.558242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.558301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.558441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.558574] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.558662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.558720] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.558854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.558932] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.559017] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.559110] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.061414] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02b693ca-6a80-4111-bfc9-073a1484feae: rpc.has_security_group_logging(os_id): False [ 1312.079281] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.079454] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.079525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.079745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.079836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.080068] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.080170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.080688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.080688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.080688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.080688] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.080688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.080959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.080959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.080959] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.081149] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.081242] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.081301] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.081440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.081514] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.081600] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1312.149887] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.150223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.150223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.150349] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.150494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.162611] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1312.889400] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1312.889620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.889785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.890018] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.890215] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.890329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.890395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.890560] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.890642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.890736] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.393029] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.895917] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.176672] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1314.176942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.397879] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.398309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.398309] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.398390] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.398426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.398531] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1314.425476] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.425628] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.425678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.425879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.426045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.435276] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1315.915407] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.915808] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1316.446465] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1316.446724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.446806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.447058] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.447297] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.447427] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.447497] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.447653] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.447757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.447898] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.448044] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.781428] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.781674] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.781743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.782074] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.782237] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.950666] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.951113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.951113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.951263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.951456] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.951614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.951730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.951833] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.951922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.952022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.952172] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.952293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.952341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.952464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.952598] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.952690] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.952751] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.952889] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.952964] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.953059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.953150] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.285014] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.455589] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45cf2c25-d2a0-4c1d-8782-458368956d4a: rpc.has_security_group_logging(os_id): False [ 1317.473124] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.473289] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.473358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.473549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.473638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.473847] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.473952] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.474021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.474178] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.474258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.474440] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.474603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.474603] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.474733] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.474813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.474993] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.475156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.475213] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.475357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.475536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.475628] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1317.535311] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.535677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.535677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.535677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.536032] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.560491] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1317.788263] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.290380] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1318.290756] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1319.069242] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.069432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.069432] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.069621] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.082311] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1319.083149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.083983] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1319.119014] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.119183] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.119271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.119491] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.131697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.132524] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1319.132613] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1319.132688] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1319.168069] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.168337] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.168337] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.168469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.169710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.169879] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1319.241493] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.241698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.241761] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.241941] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.242296] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.242603] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1319.313306] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.313730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.313730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.313730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.314024] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.314321] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1319.314423] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'3c8a8134-468e-45a8-a7ad-121c2c56d34d', 'f6ff3703-4f0f-4e11-8846-e36203877107', '9da9f265-ecd5-4341-a63a-3d1380826075', 'ab38e957-a1f6-4899-8baa-e3b1e3516ffc', 'ce95814a-dc89-465e-b193-75e16b57b822', '54be61ed-09b8-4c7e-8b2a-07214a54018b', '3d692f86-e9ca-4af4-a87e-f20b0b67b76d', 'cca2232a-e86b-4244-935e-7ec99c85e7c0', 'a25ae988-23bf-4081-a73c-bf94ad1bd3f0', '521d23d6-a304-4823-bf14-9899102d1eac', '34219d1a-fbd9-401c-90a3-4321fbe00e34', 'ad9ffe14-4877-41a7-8b4e-cba70585158e', '0c879b90-76f3-430e-8b1f-ba2fe27e511f', 'efccc372-9e22-4eea-9577-4fd80da780f3', '8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f', '90e6d13e-7877-4688-9ade-504a1a3d2a71', 'ffc805fb-8c1f-41b4-83d2-89346f31ff05', '02b693ca-6a80-4111-bfc9-073a1484feae', 'ac810154-f096-4495-a2c8-d43e5bb3d1a2', '5bd6af1f-0d53-486d-ac51-c6ef7bb925cc', 'cd53af51-8db9-4653-95a6-3f457b519312', '11aa9110-c05f-4ee9-95eb-9ace6aec4c6a', '25192273-bc3e-4f3a-9543-1ed380b4ef9b', 'a9c01b37-5156-42f7-b415-81d83f30f935', '63aea974-cdb8-4b5a-9001-4a1c99d2d349', '9c1ac393-0d0d-48c1-adc3-b358d19ecbca', 'b889aaff-9fca-4d8b-92bf-300934a13f44', '92008a16-dbb6-4fa9-bbfd-5faf35617bb1', '690e1872-1ae4-4c49-8159-ec39c82e2868', 'dd722ad1-4b5d-44e6-b813-2502626f7fdc', 'ef9a8fab-b1c1-4d0d-9d99-1ff373ce9190', '45cf2c25-d2a0-4c1d-8782-458368956d4a', 'e760e2e0-3e38-4b10-a3c7-8fe274472ed2', 'f5145c69-8ea2-4421-9b34-0a1bbf81d37d', '7c35014e-8d95-4c20-872d-da537d220b20', '67fa0349-fc9a-4525-98b6-98f14f9e267b', '26d75834-c6a8-4d76-af3a-6cec3f2d79e2', 'deec7c2d-a3e1-4f84-97a5-b5433b7b69ff', '326bee86-2025-4239-98be-95f9262ac7a3', 'b81759fd-827f-4158-bff1-7caece3251c2', '27b912c1-294b-407e-bd8a-c81f04912b02', '7b0043ff-d285-4932-aeae-115f9e86d947', 'db4ef3a0-bf1a-4fa4-b038-850d2015902e', '6295f807-c8cc-45a3-b9fc-b308b1e64f78', '8957cc88-35b6-4fdf-abb0-bfb0a5573c22'} {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1319.314542] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1319.331361] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.331506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.331506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.331678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.331759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.331858] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1319.331930] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1319.332008] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1319.397782] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.398026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.398111] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.398243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.399356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.399619] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1319.399696] env[69647]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69647) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1319.399762] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1319.399821] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1319.399898] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1319.399965] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d with Priority: HIGH for action security_group_rules [ 1319.400055] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGH for action security_group_rules [ 1319.400122] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGH for action security_group_rules [ 1319.400181] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGH for action security_group_rules [ 1319.400243] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGH for action security_group_rules [ 1319.400304] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGH for action security_group_rules [ 1319.400358] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGH for action security_group_rules [ 1319.400425] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGH for action security_group_rules [ 1319.400470] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGH for action security_group_rules [ 1319.400530] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGH for action security_group_rules [ 1319.400577] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGH for action security_group_rules [ 1319.400635] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGH for action security_group_rules [ 1319.400685] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f with Priority: HIGH for action security_group_rules [ 1319.400745] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGH for action security_group_rules [ 1319.400825] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f with Priority: HIGH for action security_group_rules [ 1319.400951] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 with Priority: HIGH for action security_group_rules [ 1319.401097] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 with Priority: HIGH for action security_group_rules [ 1319.401215] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGH for action security_group_rules [ 1319.401326] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGH for action security_group_rules [ 1319.401432] env[69647]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGH for action security_group_rules [ 1319.401573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.575477] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1319.575710] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.917318] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.917716] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1320.917716] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d with Priority: HIGH for action security_group_rules [ 1320.917716] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da9f265-ecd5-4341-a63a-3d1380826075 with Priority: HIGH for action security_group_rules [ 1320.917874] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d with Priority: HIGH for action security_group_rules [ 1320.917874] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f with Priority: HIGH for action security_group_rules [ 1320.917967] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc with Priority: HIGH for action security_group_rules [ 1320.918178] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 with Priority: HIGH for action security_group_rules [ 1320.918359] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGH for action security_group_rules [ 1320.918471] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 with Priority: HIGH for action security_group_rules [ 1320.918572] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efccc372-9e22-4eea-9577-4fd80da780f3 with Priority: HIGH for action security_group_rules [ 1320.918667] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 with Priority: HIGH for action security_group_rules [ 1320.918760] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f with Priority: HIGH for action security_group_rules [ 1320.918853] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ffe14-4877-41a7-8b4e-cba70585158e with Priority: HIGH for action security_group_rules [ 1320.918941] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 with Priority: HIGH for action security_group_rules [ 1320.919044] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521d23d6-a304-4823-bf14-9899102d1eac with Priority: HIGH for action security_group_rules [ 1320.919136] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 with Priority: HIGH for action security_group_rules [ 1320.919225] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b with Priority: HIGH for action security_group_rules [ 1320.919340] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 with Priority: HIGH for action security_group_rules [ 1320.919466] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce95814a-dc89-465e-b193-75e16b57b822 with Priority: HIGH for action security_group_rules [ 1320.919558] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ff3703-4f0f-4e11-8846-e36203877107 with Priority: HIGH for action security_group_rules [ 1320.919649] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc with Priority: HIGH for action security_group_rules [ 1320.919995] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c8a8134-468e-45a8-a7ad-121c2c56d34d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.920141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.920205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.920590] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.920707] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c8a8134-468e-45a8-a7ad-121c2c56d34d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.921878] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9da9f265-ecd5-4341-a63a-3d1380826075 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.922059] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.922146] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.922373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.922473] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9da9f265-ecd5-4341-a63a-3d1380826075',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.923413] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.923686] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.923981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.924163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.924286] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d692f86-e9ca-4af4-a87e-f20b0b67b76d',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.927133] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.927292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.927379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.927624] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.927837] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.928919] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.929176] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.929264] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.929459] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.929570] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bd6af1f-0d53-486d-ac51-c6ef7bb925cc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.931322] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.931485] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.931565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.931855] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.931855] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac810154-f096-4495-a2c8-d43e5bb3d1a2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.932687] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.932769] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.932854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.933056] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.933145] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.934045] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffc805fb-8c1f-41b4-83d2-89346f31ff05 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.934185] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.934255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.934411] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.934483] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffc805fb-8c1f-41b4-83d2-89346f31ff05',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.935928] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efccc372-9e22-4eea-9577-4fd80da780f3 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.936246] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.936336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.936679] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.936767] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efccc372-9e22-4eea-9577-4fd80da780f3',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.937679] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90e6d13e-7877-4688-9ade-504a1a3d2a71 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.937765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.937765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.937945] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.938039] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90e6d13e-7877-4688-9ade-504a1a3d2a71',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.938732] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c879b90-76f3-430e-8b1f-ba2fe27e511f taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.938824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.938890] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.939194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.939283] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c879b90-76f3-430e-8b1f-ba2fe27e511f',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.940158] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad9ffe14-4877-41a7-8b4e-cba70585158e taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.940300] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.940371] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.940521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.940682] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad9ffe14-4877-41a7-8b4e-cba70585158e',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.941335] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34219d1a-fbd9-401c-90a3-4321fbe00e34 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.941441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.941503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.941649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.941721] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34219d1a-fbd9-401c-90a3-4321fbe00e34',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.942386] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521d23d6-a304-4823-bf14-9899102d1eac taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.942504] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.942569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.942717] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.942787] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521d23d6-a304-4823-bf14-9899102d1eac',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.943760] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.943922] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.944320] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.944574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.944651] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a25ae988-23bf-4081-a73c-bf94ad1bd3f0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.945894] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54be61ed-09b8-4c7e-8b2a-07214a54018b taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.946085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.946156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.946410] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.946451] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54be61ed-09b8-4c7e-8b2a-07214a54018b',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.947190] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cca2232a-e86b-4244-935e-7ec99c85e7c0 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.947481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.947481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.947481] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.947481] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cca2232a-e86b-4244-935e-7ec99c85e7c0',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.948381] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce95814a-dc89-465e-b193-75e16b57b822 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.948489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.948562] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.948760] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.948861] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce95814a-dc89-465e-b193-75e16b57b822',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.949649] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6ff3703-4f0f-4e11-8846-e36203877107 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.949747] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.949807] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.949950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.950070] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6ff3703-4f0f-4e11-8846-e36203877107',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.950861] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.950966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.950966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.951149] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.951224] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab38e957-a1f6-4899-8baa-e3b1e3516ffc',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.975408] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.975654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.975654] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.975791] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.977913] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.978053] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.978665] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.978755] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.993842] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.993962] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac810154-f096-4495-a2c8-d43e5bb3d1a2 is going to be deleted. [ 1320.994861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.995081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.010521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.010654] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9da9f265-ecd5-4341-a63a-3d1380826075 is going to be deleted. [ 1321.011361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.011549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.030225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.030355] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c8a8134-468e-45a8-a7ad-121c2c56d34d is going to be deleted. [ 1321.048384] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.048578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.048632] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.048826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.048916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.049043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac810154-f096-4495-a2c8-d43e5bb3d1a2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.060584] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.060733] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.060778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.060930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.061022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.061183] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9da9f265-ecd5-4341-a63a-3d1380826075" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.085681] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.085846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.085911] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.086057] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.086143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.086255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c8a8134-468e-45a8-a7ad-121c2c56d34d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.446592] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.446850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.446850] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.447027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.448465] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.448620] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.462993] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.463225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.463225] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.463463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.463463] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.463575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.463614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.463750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.463830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.463914] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.464017] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.476030] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.476170] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d692f86-e9ca-4af4-a87e-f20b0b67b76d is going to be deleted. [ 1321.477397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.477582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.503187] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.503373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.504011] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.504115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.506833] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.506972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.508158] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.508258] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.509098] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.509188] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.509878] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.509972] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.510673] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.510765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.512379] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.512462] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.513241] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.513334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.515213] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.515322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.516805] env[69647]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1321.517193] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.517293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.517925] env[69647]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1321.518322] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.518414] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.518962] env[69647]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1321.519336] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.519446] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.520075] env[69647]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1321.520440] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.520551] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bd6af1f-0d53-486d-ac51-c6ef7bb925cc is going to be deleted. [ 1321.521435] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.521639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.523038] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.523136] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.540328] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.540469] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffc805fb-8c1f-41b4-83d2-89346f31ff05 is going to be deleted. [ 1321.541265] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.541413] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.557423] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.557540] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.560180] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.560267] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f is going to be deleted. [ 1321.561036] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.561231] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.579441] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.579653] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a25ae988-23bf-4081-a73c-bf94ad1bd3f0 is going to be deleted. [ 1321.580513] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.580776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.582271] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.582404] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.594471] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.594630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.609311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.609473] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c879b90-76f3-430e-8b1f-ba2fe27e511f is going to be deleted. [ 1321.610391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.610639] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.623388] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.623545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.628591] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.628710] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34219d1a-fbd9-401c-90a3-4321fbe00e34 is going to be deleted. [ 1321.629629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.629872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.670865] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.671096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.694468] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.694602] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6ff3703-4f0f-4e11-8846-e36203877107 is going to be deleted. [ 1321.695630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.695839] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.708500] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.708617] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.718479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.718565] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efccc372-9e22-4eea-9577-4fd80da780f3 is going to be deleted. [ 1321.719373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.719576] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.722052] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.722170] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.747266] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.747529] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad9ffe14-4877-41a7-8b4e-cba70585158e is going to be deleted. [ 1321.749207] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.749556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.770733] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.770985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.776822] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.777051] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521d23d6-a304-4823-bf14-9899102d1eac is going to be deleted. [ 1321.778137] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.778379] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.792667] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.792794] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.807793] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.807982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.812487] env[69647]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1321.813031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.813198] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90e6d13e-7877-4688-9ade-504a1a3d2a71 is going to be deleted. [ 1321.814268] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.814582] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.830021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.830150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.832457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.832578] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab38e957-a1f6-4899-8baa-e3b1e3516ffc is going to be deleted. [ 1321.833444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.833649] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.861720] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.861851] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce95814a-dc89-465e-b193-75e16b57b822 is going to be deleted. [ 1321.862872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.863107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.883396] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.883545] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.884717] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.884862] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54be61ed-09b8-4c7e-8b2a-07214a54018b is going to be deleted. [ 1321.885717] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.885931] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.910774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.910943] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cca2232a-e86b-4244-935e-7ec99c85e7c0 is going to be deleted. [ 1321.911878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.912133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.912208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.912323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d692f86-e9ca-4af4-a87e-f20b0b67b76d" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.913121] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.913245] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.913291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.913457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.913650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.913650] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab38e957-a1f6-4899-8baa-e3b1e3516ffc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.913809] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.913916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.913990] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.914121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bd6af1f-0d53-486d-ac51-c6ef7bb925cc" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.914597] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.914770] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.914882] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.915016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffc805fb-8c1f-41b4-83d2-89346f31ff05" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.915155] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.915298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.915374] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.915483] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d8ed4b8-b70c-4e41-b98b-7000a42cdb1f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.915589] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.915724] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.915797] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.915907] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a25ae988-23bf-4081-a73c-bf94ad1bd3f0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.916049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.916203] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.916370] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.916424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34219d1a-fbd9-401c-90a3-4321fbe00e34" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.916494] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.916627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.916789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.916789] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c879b90-76f3-430e-8b1f-ba2fe27e511f" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.916920] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.917150] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.917223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.917335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6ff3703-4f0f-4e11-8846-e36203877107" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.917445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.917677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.917677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.917754] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efccc372-9e22-4eea-9577-4fd80da780f3" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.917858] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.918076] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.918138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.918243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad9ffe14-4877-41a7-8b4e-cba70585158e" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.918350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.918498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.918571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.918662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521d23d6-a304-4823-bf14-9899102d1eac" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.918788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.918921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.918993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.919108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90e6d13e-7877-4688-9ade-504a1a3d2a71" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.971747] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.971853] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.971926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.972159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.972319] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.972418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.972480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.973507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.973507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.973507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.973507] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.973507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.973507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.973507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.973507] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.973507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.973507] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.973887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.973887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.973887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.973887] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.975492] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.975625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.975697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.975864] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.975947] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.976068] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce95814a-dc89-465e-b193-75e16b57b822" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.981154] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.981325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.981416] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.981787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.981934] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.982143] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54be61ed-09b8-4c7e-8b2a-07214a54018b" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.983455] env[69647]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1321.983909] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.984031] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.984096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.984276] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.984357] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.984471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cca2232a-e86b-4244-935e-7ec99c85e7c0" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.477415] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02b693ca-6a80-4111-bfc9-073a1484feae: rpc.has_security_group_logging(os_id): False [ 1322.494642] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.494824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.494824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.495108] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.515424] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.515695] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.515821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.515888] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.516097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.516183] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.516378] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.516479] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.516542] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.516692] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.516765] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.516967] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.517077] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.517141] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.517285] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.517359] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.517447] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1322.572828] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.572987] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.573043] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.573198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.573335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.587446] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1322.861252] env[69647]: INFO networking_nsxv3.common.synchronization [req-49120a86-b739-47d0-a7e8-d16eec1bc378 req-46e94153-e853-4452-a2f5-842014994cec tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1322.862043] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1322.862196] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.862196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.862279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.862768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.862768] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.862768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.862768] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.862960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.862960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.863032] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.364916] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.867668] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.370019] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.370322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.370322] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.370456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.370546] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.370646] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1324.450141] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.450319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.450368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.450539] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.450683] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.459602] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1324.610959] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1324.611222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.469701] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1326.470097] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.862565] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.862892] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.480175] env[69647]: INFO networking_nsxv3.common.synchronization [req-9b9be230-d79e-48c1-b2c7-e61583ede4de req-9fc3e1e6-7d1c-42ac-819a-e492d6254159 tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1329.481244] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1329.481381] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.481658] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.481658] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.481876] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.481876] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.481996] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.482067] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.482197] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.482341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.482341] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.984883] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.487055] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.812809] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f273285-61d9-4a08-8209-0989fe11a803 req-e1a332a1-4eda-4ec8-9290-89c53efee13b tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1330.813335] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1330.813633] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.813759] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.813817] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.814021] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.814204] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.814299] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.814445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.814495] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.814575] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.814665] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.989559] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.989725] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.989955] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.990033] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.990115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.990216] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1331.021364] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.021607] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.021708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.021971] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.022194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.031176] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1331.088956] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-624 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.089177] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.089310] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.089616] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.089874] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.090046] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.090171] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.090383] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.090526] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.090738] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1331.090852] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1331.090961] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1331.091085] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1331.091200] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1331.091306] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1331.091438] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1331.125878] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1331.126028] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1331.126138] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1331.126376] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-624" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.126658] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-1c438b01-0179-4864-a1ef-b21c8a0f2831 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.126821] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-1c438b01-0179-4864-a1ef-b21c8a0f2831" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.126940] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-1c438b01-0179-4864-a1ef-b21c8a0f2831" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.127295] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-1c438b01-0179-4864-a1ef-b21c8a0f2831" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.127434] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c438b01-0179-4864-a1ef-b21c8a0f2831',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.316458] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.629688] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.630041] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.630126] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.630361] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.630547] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.630676] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 1c438b01-0179-4864-a1ef-b21c8a0f2831 not found, creating... [ 1331.630937] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.631105] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.631225] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.631445] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.631578] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.631854] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.632015] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.632142] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.632350] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.632481] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.632619] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 1c438b01-0179-4864-a1ef-b21c8a0f2831 is going to be created. [ 1331.651267] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.651460] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.651583] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.651826] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.652061] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.652282] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-1c438b01-0179-4864-a1ef-b21c8a0f2831" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.819593] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.314352] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f273285-61d9-4a08-8209-0989fe11a803 req-fd503f0d-bbd2-49e1-ac28-c26f21001ae9 service nova] Enqueued Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_rules [ 1332.314535] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f273285-61d9-4a08-8209-0989fe11a803 req-fd503f0d-bbd2-49e1-ac28-c26f21001ae9 service nova] Enqueued Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1332.314672] env[69647]: INFO networking_nsxv3.common.synchronization [req-2f273285-61d9-4a08-8209-0989fe11a803 req-fd503f0d-bbd2-49e1-ac28-c26f21001ae9 service nova] Enqueued Resource ID: 1c438b01-0179-4864-a1ef-b21c8a0f2831 with Priority: HIGHEST for action port [ 1332.315285] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_rules [ 1332.315399] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1332.315496] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c438b01-0179-4864-a1ef-b21c8a0f2831 with Priority: HIGHEST for action port [ 1332.315759] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.315887] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.315954] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.316167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.316249] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.317095] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.317192] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.317394] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c438b01-0179-4864-a1ef-b21c8a0f2831 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.317499] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c438b01-0179-4864-a1ef-b21c8a0f2831" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.317549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c438b01-0179-4864-a1ef-b21c8a0f2831" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.317707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c438b01-0179-4864-a1ef-b21c8a0f2831" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.317846] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c438b01-0179-4864-a1ef-b21c8a0f2831',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.322317] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.322426] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.322496] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.322656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.322925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.322925] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b81759fd-827f-4158-bff1-7caece3251c2 is going to be updated. [ 1332.352074] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.352237] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.352287] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.352447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.352586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.361477] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: IN_PROGRESS for 2s [ 1332.819070] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.819841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.819841] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c438b01-0179-4864-a1ef-b21c8a0f2831 with status ACTIVE [ 1332.819841] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.819841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.819841] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.820171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.820171] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.820236] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.820279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.820323] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.820508] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.820631] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.820769] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.820861] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.820912] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.821062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.821133] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.821220] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c438b01-0179-4864-a1ef-b21c8a0f2831 is going to be updated. [ 1332.839942] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.840112] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.840174] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.840489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.840489] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.840635] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c438b01-0179-4864-a1ef-b21c8a0f2831" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.041027] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1333.041277] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.371086] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: SUCCESS [ 1334.371464] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.371825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.372060] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.372242] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.372361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.372425] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.372581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.372660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.372755] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.875451] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.379999] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.882294] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.882509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.882509] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.882737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.882830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.882955] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b81759fd-827f-4158-bff1-7caece3251c2 is going to be updated. [ 1335.911858] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.912085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.912085] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.912209] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.912350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.921256] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: IN_PROGRESS for 2s [ 1337.316525] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1337.316895] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1337.932344] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: SUCCESS [ 1337.932552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.932716] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.932935] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.933142] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.933253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.933319] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.933472] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.933578] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.933696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.933740] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.435852] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.618656] env[69647]: INFO networking_nsxv3.common.synchronization [req-7abdbba9-5b87-4aca-938d-0a6f03b254f6 req-69300dd3-fee0-430f-a835-8c965b6cd0ee tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1338.619191] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1338.619507] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.619627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.619697] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.619891] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.620102] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.620156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.620191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.620350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.620418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.620535] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.938461] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b81759fd-827f-4158-bff1-7caece3251c2: rpc.has_security_group_logging(os_id): False [ 1338.956526] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.956677] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.956750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.956962] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.978061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.978061] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.978061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.978061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.978061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.978061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.978061] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b81759fd-827f-4158-bff1-7caece3251c2 is going to be updated. [ 1338.983151] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.983421] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.983505] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.983750] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.984027] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.984195] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.984317] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.984533] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.984676] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.984889] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1338.985078] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1338.985327] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1338.985471] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1338.985601] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1338.985719] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1338.985860] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1339.001949] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1339.002155] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1339.002268] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1339.002448] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.002749] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-b1f585b9-79db-4def-b4e3-60d66799b6a1 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.002920] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-b1f585b9-79db-4def-b4e3-60d66799b6a1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.003056] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-b1f585b9-79db-4def-b4e3-60d66799b6a1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.003420] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-b1f585b9-79db-4def-b4e3-60d66799b6a1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.003582] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f585b9-79db-4def-b4e3-60d66799b6a1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.030746] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.030981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.030981] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.031201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.031346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.042344] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: IN_PROGRESS for 2s [ 1339.124797] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.506440] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.506802] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.506802] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.506966] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.508331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.508331] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port b1f585b9-79db-4def-b4e3-60d66799b6a1 not found, creating... [ 1339.508331] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.508331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.508331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.508331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.508331] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.508667] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.508725] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.508795] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.509015] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.509155] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.509296] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: b1f585b9-79db-4def-b4e3-60d66799b6a1 is going to be created. [ 1339.527916] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.528116] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.528237] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.528482] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.528704] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.528919] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-b1f585b9-79db-4def-b4e3-60d66799b6a1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.627691] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.129821] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.129982] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.130096] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.130273] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.130365] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.130464] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1340.157758] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.157897] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.157966] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.158201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.158341] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.170165] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1340.224020] env[69647]: INFO networking_nsxv3.common.synchronization [req-7abdbba9-5b87-4aca-938d-0a6f03b254f6 req-33422296-b56e-4fd1-af8c-5058da9581fb service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1340.224243] env[69647]: INFO networking_nsxv3.common.synchronization [req-7abdbba9-5b87-4aca-938d-0a6f03b254f6 req-33422296-b56e-4fd1-af8c-5058da9581fb service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1340.224396] env[69647]: INFO networking_nsxv3.common.synchronization [req-7abdbba9-5b87-4aca-938d-0a6f03b254f6 req-33422296-b56e-4fd1-af8c-5058da9581fb service nova] Enqueued Resource ID: b1f585b9-79db-4def-b4e3-60d66799b6a1 with Priority: HIGHEST for action port [ 1340.224643] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1340.224766] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1340.224870] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f585b9-79db-4def-b4e3-60d66799b6a1 with Priority: HIGHEST for action port [ 1340.225829] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.225977] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.226618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.226828] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.229027] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.229027] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.229027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.229027] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1f585b9-79db-4def-b4e3-60d66799b6a1 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.229027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1f585b9-79db-4def-b4e3-60d66799b6a1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.229027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1f585b9-79db-4def-b4e3-60d66799b6a1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.229363] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1f585b9-79db-4def-b4e3-60d66799b6a1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.229363] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f585b9-79db-4def-b4e3-60d66799b6a1',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.731202] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1f585b9-79db-4def-b4e3-60d66799b6a1 with status ACTIVE [ 1340.731729] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.731879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.731948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.732177] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.732269] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.732449] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.732547] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.732638] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.732747] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.732824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.733008] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.733104] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.733159] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.733298] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.733370] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.733451] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1f585b9-79db-4def-b4e3-60d66799b6a1 is going to be updated. [ 1340.734581] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.734691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.754305] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.754482] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.754553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.754762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.754900] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.755083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1f585b9-79db-4def-b4e3-60d66799b6a1" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.057029] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: SUCCESS [ 1341.057029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.323712] env[69647]: INFO networking_nsxv3.common.synchronization [None req-de7575f5-4b76-4bd0-a09a-e316b6324376 tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 7c98d77f-85d1-41ca-b8a2-e8065209afdb with Priority: HIGHEST for action security_group_rules [ 1341.324245] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c98d77f-85d1-41ca-b8a2-e8065209afdb with Priority: HIGHEST for action security_group_rules [ 1341.324549] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c98d77f-85d1-41ca-b8a2-e8065209afdb taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.325688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c98d77f-85d1-41ca-b8a2-e8065209afdb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.325688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c98d77f-85d1-41ca-b8a2-e8065209afdb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.325688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c98d77f-85d1-41ca-b8a2-e8065209afdb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.325688] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c98d77f-85d1-41ca-b8a2-e8065209afdb',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.388343] env[69647]: INFO networking_nsxv3.common.synchronization [None req-168d15d3-d3c3-4d16-8bda-84011cb980ad tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 7c98d77f-85d1-41ca-b8a2-e8065209afdb with Priority: HIGHEST for action security_group_rules [ 1341.388883] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c98d77f-85d1-41ca-b8a2-e8065209afdb with Priority: HIGHEST for action security_group_rules [ 1341.389197] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c98d77f-85d1-41ca-b8a2-e8065209afdb taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.389302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c98d77f-85d1-41ca-b8a2-e8065209afdb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.845509] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.845830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.845830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.845936] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.846022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.846116] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c98d77f-85d1-41ca-b8a2-e8065209afdb already deleted. [ 1341.846201] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c98d77f-85d1-41ca-b8a2-e8065209afdb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.846356] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c98d77f-85d1-41ca-b8a2-e8065209afdb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.846524] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c98d77f-85d1-41ca-b8a2-e8065209afdb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.846607] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c98d77f-85d1-41ca-b8a2-e8065209afdb',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.179014] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1342.179280] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.179469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.179714] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.179920] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.180066] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.180146] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.180335] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.180423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.180537] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.365343] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.365515] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.365555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.365737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.365825] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.365921] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c98d77f-85d1-41ca-b8a2-e8065209afdb already deleted. [ 1342.366009] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c98d77f-85d1-41ca-b8a2-e8065209afdb" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.682415] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.185118] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.686851] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.687107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.687107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.687355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.687449] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.687553] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1343.733779] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.733983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.733983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.734117] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.734260] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.743940] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1344.747276] env[69647]: INFO networking_nsxv3.common.synchronization [req-d58bb236-344a-485d-afbd-f2cca6c8b222 req-38d077ce-8a53-4c09-8840-78c8427bc291 tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1344.747889] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1344.748134] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.748257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.748355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.748569] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.748748] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.748860] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.748921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.749218] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.749387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.749488] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.252249] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.252469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.252469] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.252670] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.252762] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.252948] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.253054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.253113] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.253257] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.253332] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.253418] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1345.280869] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.281048] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.281100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.281308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.281456] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.290254] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1345.754338] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1345.754338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.754338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.754338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.754338] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.754338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.755366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.755366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.755366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.755366] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.755366] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.257308] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.257556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.257627] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.257847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.258059] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.258196] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.258262] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.258445] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.258543] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.258636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.258784] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.258879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.258968] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.259130] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.259303] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.259423] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.259492] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.259660] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.259743] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.259829] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.259954] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.762619] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45cf2c25-d2a0-4c1d-8782-458368956d4a: rpc.has_security_group_logging(os_id): False [ 1346.779707] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.779965] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.779965] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.780194] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.798346] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.798612] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.798742] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.798793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.799042] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.799146] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.799357] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.799460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.799573] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.799739] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.799813] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.799989] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.800093] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.800152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.800318] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.800393] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.800489] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1346.860239] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.860447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.860447] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.860626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.860757] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.876063] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1347.301144] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1347.301437] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae deletion is rescheduled due to dependency. [ 1347.301552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.685374] env[69647]: INFO networking_nsxv3.common.synchronization [req-e29fe81e-be7f-4291-8b6e-e6a540d22638 req-14abfdad-3702-4586-b453-48b8adf83f48 tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1347.685902] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1347.685902] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.686022] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.686064] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.686249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.686405] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.686521] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.686557] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.686699] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.686780] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.686882] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.929895] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.930220] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.930220] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.930563] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.930819] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.930978] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.931110] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.931349] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.931467] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.931674] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1347.931787] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1347.931895] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1347.932009] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1347.932127] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1347.932234] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1347.932509] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1347.950370] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1347.950518] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1347.950656] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1347.950813] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.951083] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-d524d492-6702-4ee3-8f8c-dbb5e2ce834a taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.951247] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-d524d492-6702-4ee3-8f8c-dbb5e2ce834a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.951369] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-d524d492-6702-4ee3-8f8c-dbb5e2ce834a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.951649] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-d524d492-6702-4ee3-8f8c-dbb5e2ce834a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.951787] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d524d492-6702-4ee3-8f8c-dbb5e2ce834a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.189861] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.190049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.190124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.190615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.190615] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.190615] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.190732] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.190796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.190948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.191037] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.191125] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1348.218572] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.218750] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.218803] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.218940] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.219095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.226882] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1348.453910] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.454105] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.454241] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.454530] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.454678] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.454834] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port d524d492-6702-4ee3-8f8c-dbb5e2ce834a not found, creating... [ 1348.455107] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.455269] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.455390] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.455606] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.455744] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.456041] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.456203] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.456325] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.456534] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.456670] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.456809] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: d524d492-6702-4ee3-8f8c-dbb5e2ce834a is going to be created. [ 1348.476678] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.476839] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.476966] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.477229] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.477432] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.477653] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-d524d492-6702-4ee3-8f8c-dbb5e2ce834a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.895625] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1348.895625] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.152106] env[69647]: INFO networking_nsxv3.common.synchronization [req-e29fe81e-be7f-4291-8b6e-e6a540d22638 req-260f0aaf-77b1-4de6-be94-4712a8fd688b service nova] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_rules [ 1349.152106] env[69647]: INFO networking_nsxv3.common.synchronization [req-e29fe81e-be7f-4291-8b6e-e6a540d22638 req-260f0aaf-77b1-4de6-be94-4712a8fd688b service nova] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1349.152106] env[69647]: INFO networking_nsxv3.common.synchronization [req-e29fe81e-be7f-4291-8b6e-e6a540d22638 req-260f0aaf-77b1-4de6-be94-4712a8fd688b service nova] Enqueued Resource ID: d524d492-6702-4ee3-8f8c-dbb5e2ce834a with Priority: HIGHEST for action port [ 1349.152106] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_rules [ 1349.152106] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1349.152106] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d524d492-6702-4ee3-8f8c-dbb5e2ce834a with Priority: HIGHEST for action port [ 1349.152984] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.153358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.153642] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.153948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.154729] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.155466] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.155696] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.155948] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-d524d492-6702-4ee3-8f8c-dbb5e2ce834a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.156095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d524d492-6702-4ee3-8f8c-dbb5e2ce834a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.156189] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d524d492-6702-4ee3-8f8c-dbb5e2ce834a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.156391] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d524d492-6702-4ee3-8f8c-dbb5e2ce834a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.156506] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d524d492-6702-4ee3-8f8c-dbb5e2ce834a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.656433] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.656687] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.657833] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d524d492-6702-4ee3-8f8c-dbb5e2ce834a with status ACTIVE [ 1349.658032] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.658164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.658247] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.658463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.658552] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.658723] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.658824] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.658892] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.659049] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.659121] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.659291] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.659405] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.659480] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.659618] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.659695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.659766] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d524d492-6702-4ee3-8f8c-dbb5e2ce834a is going to be updated. [ 1349.679811] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.679927] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.679998] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.680173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.680327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.680488] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d524d492-6702-4ee3-8f8c-dbb5e2ce834a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.236059] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1350.236307] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae deletion is rescheduled due to dependency. [ 1350.236350] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.236506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.236706] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.236876] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.236991] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.237069] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.237243] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.237324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.237420] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.739957] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.243085] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.291810] env[69647]: INFO networking_nsxv3.common.synchronization [req-76991634-68a9-41f0-b46d-387d66c79b96 req-489d2cac-2d0a-4d1b-b966-c53ca647fdc5 tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1351.291810] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1351.291942] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.292088] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.292142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.293527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.293527] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.293527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.293527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.293527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.293527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.293527] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.745215] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.745397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.745471] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.745695] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.745778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.745879] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1351.775708] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.775836] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.775908] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.776124] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.776267] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.784451] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1351.794850] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.297074] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.799587] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.799777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.799851] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.800107] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.800200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.800303] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1352.826139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.826263] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.826338] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.826523] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.826663] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.833997] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1353.794424] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1353.794863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.794863] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.795027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.795200] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.795307] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.795397] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.795525] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.795605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.795688] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.795778] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.297718] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.297950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.297950] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.298204] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.298442] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.298555] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.298636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.298855] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.298956] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.299062] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.299215] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.299311] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.299373] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.299549] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.299749] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.299852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.299916] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.300072] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.300152] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.300238] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.300330] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.803056] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02b693ca-6a80-4111-bfc9-073a1484feae: rpc.has_security_group_logging(os_id): False [ 1354.820291] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.820291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.820291] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.820553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.820553] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.820623] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.820723] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.820787] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.820931] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.821015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.821203] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.821297] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.821360] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.821498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.821570] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.821755] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.821846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.821906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.822068] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.822144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.822230] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1354.841451] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1354.841630] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.877361] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.877551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.877551] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.877744] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.877884] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.891161] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1356.293091] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.293508] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1356.956847] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1356.957083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.380914] env[69647]: INFO networking_nsxv3.common.synchronization [req-859c2453-b039-483b-b1a3-961144870dec req-baca63ea-1b4e-425d-a597-cc440e6cf321 tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1360.381438] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1360.381743] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.381868] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.381926] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.382147] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.382298] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.382399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.382460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.382600] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.382682] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.382774] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.646834] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.647050] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.647536] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.647823] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.648097] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.648274] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.648398] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.648665] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.648812] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.649049] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1360.649169] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1360.649285] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1360.649395] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1360.649534] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1360.649666] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1360.649799] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1360.668228] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1360.668337] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1360.668520] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1360.668640] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-891" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.668924] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-10e12b26-8934-48f4-8c32-7b20b8e85d79 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.669111] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-10e12b26-8934-48f4-8c32-7b20b8e85d79" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.669271] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-10e12b26-8934-48f4-8c32-7b20b8e85d79" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.669608] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-10e12b26-8934-48f4-8c32-7b20b8e85d79" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.669809] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10e12b26-8934-48f4-8c32-7b20b8e85d79',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.885169] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.174557] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.174983] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.175171] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.175484] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.175648] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.175832] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 10e12b26-8934-48f4-8c32-7b20b8e85d79 not found, creating... [ 1361.176093] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.176257] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.176377] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.176602] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.176739] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.177049] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.177243] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.177360] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.177584] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.177752] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.178269] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 10e12b26-8934-48f4-8c32-7b20b8e85d79 is going to be created. [ 1361.196189] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.196289] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.196413] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.196689] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.196919] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.197155] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-10e12b26-8934-48f4-8c32-7b20b8e85d79" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.388064] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.863991] env[69647]: INFO networking_nsxv3.common.synchronization [req-859c2453-b039-483b-b1a3-961144870dec req-73cd2846-10d9-4d6e-962a-aac09d3eea35 service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1361.864202] env[69647]: INFO networking_nsxv3.common.synchronization [req-859c2453-b039-483b-b1a3-961144870dec req-73cd2846-10d9-4d6e-962a-aac09d3eea35 service nova] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1361.864344] env[69647]: INFO networking_nsxv3.common.synchronization [req-859c2453-b039-483b-b1a3-961144870dec req-73cd2846-10d9-4d6e-962a-aac09d3eea35 service nova] Enqueued Resource ID: 10e12b26-8934-48f4-8c32-7b20b8e85d79 with Priority: HIGHEST for action port [ 1361.864569] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_rules [ 1361.864698] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1361.864793] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e12b26-8934-48f4-8c32-7b20b8e85d79 with Priority: HIGHEST for action port [ 1361.865488] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.865605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.865671] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.865877] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.865957] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.866759] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.866854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.867040] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-10e12b26-8934-48f4-8c32-7b20b8e85d79 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.867138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10e12b26-8934-48f4-8c32-7b20b8e85d79" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.867200] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10e12b26-8934-48f4-8c32-7b20b8e85d79" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.867400] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10e12b26-8934-48f4-8c32-7b20b8e85d79" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.867489] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10e12b26-8934-48f4-8c32-7b20b8e85d79',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.890261] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.890417] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.890457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.890648] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.890737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.890832] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1361.916941] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.917120] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.917198] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.917389] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.917510] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.926318] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1362.369030] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.369162] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.369327] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10e12b26-8934-48f4-8c32-7b20b8e85d79 with status ACTIVE [ 1362.369491] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.369846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.369885] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.370075] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.370168] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.370372] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.370505] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.370571] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.370698] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.370774] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.370956] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.371061] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.371115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.371252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.371324] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.371408] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10e12b26-8934-48f4-8c32-7b20b8e85d79 is going to be updated. [ 1362.390241] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.390563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.390563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.390563] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.390691] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.390821] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10e12b26-8934-48f4-8c32-7b20b8e85d79" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.937942] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1363.937942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.937942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.937942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.937942] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.937942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.937942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.937942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.937942] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.937942] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.441056] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.942671] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.444687] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.444985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.444985] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.445175] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.445293] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.445380] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1365.471835] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.471976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.471976] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.472173] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.472308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.480650] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1366.866412] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.866412] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1367.492154] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1367.492330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.492498] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.492767] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.492955] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.493090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.493153] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.493304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.493387] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.493475] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.493569] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.996140] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.996439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.996439] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.996611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.996781] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.997027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.997027] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.997156] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.997191] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.997261] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.997446] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.997577] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.997656] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.997806] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.997948] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.998054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.998114] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.998253] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.998329] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.998415] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.998507] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.501501] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45cf2c25-d2a0-4c1d-8782-458368956d4a: rpc.has_security_group_logging(os_id): False [ 1368.518516] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.518712] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.518777] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.518973] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.519079] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.519297] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.519399] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.519466] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.519629] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.519730] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.519954] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.520081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.520164] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.520334] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.520429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.520629] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.520745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.520814] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.520983] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.521092] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.521192] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1368.633921] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.634239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.634239] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.634418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.634581] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.667300] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1370.686128] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1370.686568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.866974] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.867468] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.798206] env[69647]: INFO networking_nsxv3.common.synchronization [req-2ca1031c-831d-4aee-a53c-aabd1cf5c7f6 req-e6dd2767-9dba-4c8a-b611-344081108459 tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1373.798745] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1373.799153] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.799302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.799368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.799561] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.799718] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.799818] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.799880] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.800016] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.800106] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.800205] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.302516] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.804939] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.307306] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.307508] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.307593] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.307815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.307906] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.308013] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1375.334752] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.334879] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.334943] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.335142] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.335279] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.342664] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1377.354843] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1377.355256] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.799380] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.799706] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.062399] env[69647]: INFO networking_nsxv3.common.synchronization [req-3f385ddb-94cb-4b0a-a05c-9270afee156b req-4d3c1e9f-56a8-4877-bd43-5a2b5b8a06a3 tempest-ServersTestJSON-703086423 tempest-ServersTestJSON-703086423-project-member] Enqueued Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1381.062717] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a with Priority: HIGHEST for action security_group_members [ 1381.063075] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-45cf2c25-d2a0-4c1d-8782-458368956d4a taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.063232] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.063304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.063533] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.063710] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.063830] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.063910] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.064089] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.064208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.064324] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45cf2c25-d2a0-4c1d-8782-458368956d4a',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.566625] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.566708] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.566745] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.567026] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.567090] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.567424] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.567503] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.567572] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.567808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.567808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.567938] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a is going to be updated. [ 1381.594075] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.594205] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.594348] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.594474] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.594636] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.602096] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: IN_PROGRESS for 2s [ 1383.613395] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a in Status: SUCCESS [ 1383.613846] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45cf2c25-d2a0-4c1d-8782-458368956d4a deletion is rescheduled due to dependency. [ 1383.613846] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45cf2c25-d2a0-4c1d-8782-458368956d4a" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.063941] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.064231] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.188979] env[69647]: INFO networking_nsxv3.common.synchronization [req-b9161737-1e37-42c9-9e75-390193c0ad5e req-4591e9f5-9ba0-4c40-8f4d-d0ebaff01ec9 tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1386.188979] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1386.188979] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.190878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.190878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.190878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.191052] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.191052] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.191144] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.191252] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.191336] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.191431] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.693592] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.693766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.693834] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.694055] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.694148] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.694348] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.694444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.694506] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.694659] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.694734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.694822] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1386.720719] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.720808] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.720961] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.721081] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.721244] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.728229] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1388.597354] env[69647]: INFO networking_nsxv3.common.synchronization [req-384b8f5e-6558-41b0-bc58-9f77df1bafbf req-77ff3e33-0919-4d3d-88e8-58f99c79f9c0 tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1388.598378] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1388.598378] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.598378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.739930] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1388.739930] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae deletion is rescheduled due to dependency. [ 1388.739930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.739930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.739930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.739930] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.739930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.739930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.739930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.739930] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.740910] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.894387] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.894387] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.894387] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.894387] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.894387] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.894387] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.894726] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.894726] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.894838] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.895146] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1388.895303] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] NeedRegenerationException {{(pid=69647) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1388.895445] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] no value, waiting for create lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1388.895614] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] value creation lock acquired {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1388.895770] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] No value present for key: 'zone-id' {{(pid=69647) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1388.895910] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Calling creation function for not-yet-present value {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1388.896090] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1388.914453] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1388.914638] env[69647]: DEBUG dogpile.cache.region [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69647) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1388.914749] env[69647]: DEBUG dogpile.lock [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Released creation lock {{(pid=69647) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1388.914907] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "network-2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.915198] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock port-57a91d48-d1c1-438d-a575-4c73b5fdc3d2 taken with stack trace [, , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.915361] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "port-57a91d48-d1c1-438d-a575-4c73b5fdc3d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.915515] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "port-57a91d48-d1c1-438d-a575-4c73b5fdc3d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.915775] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "port-57a91d48-d1c1-438d-a575-4c73b5fdc3d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.915921] env[69647]: DEBUG networking_nsxv3.api.rpc [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57a91d48-d1c1-438d-a575-4c73b5fdc3d2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1389.243594] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.243766] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.243835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.244223] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.244330] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.244581] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.244707] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.244779] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.244948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.245045] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.245140] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1389.272975] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.273119] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.273187] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.273355] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.273487] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.281257] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1389.418072] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.418072] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.418072] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.418340] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.418481] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.419476] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Segment Port 57a91d48-d1c1-438d-a575-4c73b5fdc3d2 not found, creating... [ 1389.419476] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.419476] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.419476] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.419476] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.419476] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.419797] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.419951] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.420064] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.420272] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.420439] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.420591] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Resource: SegmentPort with ID: 57a91d48-d1c1-438d-a575-4c73b5fdc3d2 is going to be created. [ 1389.439369] env[69647]: DEBUG networking_nsxv3.common.locking [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.439578] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.439707] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.439958] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.440200] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.440419] env[69647]: DEBUG oslo_concurrency.lockutils [None req-13146fac-fff6-48d2-8294-d0cd61b946bc None None] Releasing lock "port-57a91d48-d1c1-438d-a575-4c73b5fdc3d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.110339] env[69647]: INFO networking_nsxv3.common.synchronization [req-384b8f5e-6558-41b0-bc58-9f77df1bafbf req-3a124b54-02c3-496f-9af6-a4f1d1421419 service nova] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_rules [ 1390.110617] env[69647]: INFO networking_nsxv3.common.synchronization [req-384b8f5e-6558-41b0-bc58-9f77df1bafbf req-3a124b54-02c3-496f-9af6-a4f1d1421419 service nova] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1390.110660] env[69647]: INFO networking_nsxv3.common.synchronization [req-384b8f5e-6558-41b0-bc58-9f77df1bafbf req-3a124b54-02c3-496f-9af6-a4f1d1421419 service nova] Enqueued Resource ID: 57a91d48-d1c1-438d-a575-4c73b5fdc3d2 with Priority: HIGHEST for action port [ 1390.110885] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_rules [ 1390.111016] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1390.111118] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57a91d48-d1c1-438d-a575-4c73b5fdc3d2 with Priority: HIGHEST for action port [ 1390.111662] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.111776] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.111847] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.112163] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.112257] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.113082] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.113182] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.113374] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock port-57a91d48-d1c1-438d-a575-4c73b5fdc3d2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.113476] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57a91d48-d1c1-438d-a575-4c73b5fdc3d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.113565] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57a91d48-d1c1-438d-a575-4c73b5fdc3d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.113737] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57a91d48-d1c1-438d-a575-4c73b5fdc3d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.113814] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57a91d48-d1c1-438d-a575-4c73b5fdc3d2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.615710] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.615878] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.618168] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57a91d48-d1c1-438d-a575-4c73b5fdc3d2 with status ACTIVE [ 1390.618344] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.618460] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.618526] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.618734] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.618835] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.618982] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.619167] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.619229] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.619378] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.619453] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.619633] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.619726] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.619785] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.619921] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.619995] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.620089] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57a91d48-d1c1-438d-a575-4c73b5fdc3d2 is going to be updated. [ 1390.638624] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.638788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.638788] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.638944] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.639083] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.639222] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57a91d48-d1c1-438d-a575-4c73b5fdc3d2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.291139] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1391.291139] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae deletion is rescheduled due to dependency. [ 1391.291139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.291139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.291556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.291556] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.291556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.291556] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.291740] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.291778] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.291876] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.793815] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.296292] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.799118] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.799304] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.799361] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.799574] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.799662] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.799763] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1392.827704] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.827872] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.827925] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.828078] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.828215] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.835558] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1394.846102] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1394.846395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.846500] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.846720] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.846909] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.847034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.847100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.847250] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.847368] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.847429] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.847487] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.112478] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.112643] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1395.350235] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.350463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.350463] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.350752] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.350875] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.350975] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.351054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.351204] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.351292] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.351380] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.351524] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.351614] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.351681] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.351815] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.351951] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.352054] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.352115] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.352251] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.352327] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.352406] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.352493] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.854413] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02b693ca-6a80-4111-bfc9-073a1484feae: rpc.has_security_group_logging(os_id): False [ 1395.871430] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.871611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.871611] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.871826] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.871915] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.872139] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.872240] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.872302] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.872455] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.872530] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.872701] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.872796] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.872854] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.872993] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.873080] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.873266] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.873358] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.873418] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.873554] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.873626] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.873710] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1395.930160] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.930340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.930340] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.930493] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.930632] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.946231] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1397.964436] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1397.964840] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.074140] env[69647]: INFO networking_nsxv3.common.synchronization [req-9a9e568c-ca3a-4f45-9502-d49abab36822 req-64b8e4ca-ed3f-42f9-ac3e-e6931ecf85dc tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1398.074671] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1398.074981] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.075236] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.075343] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.075804] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.076024] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.076605] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.076798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.077015] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.077139] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.077262] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.579816] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.082265] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.584368] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.584536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.584610] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.584827] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.584917] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.585028] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b81759fd-827f-4158-bff1-7caece3251c2 is going to be updated. [ 1399.612730] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.612852] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.612903] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.613095] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.613234] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.621817] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: IN_PROGRESS for 2s [ 1400.060932] env[69647]: INFO networking_nsxv3.common.synchronization [req-aaf9a751-623d-4ad2-b11a-c9d438ccc105 req-368ecdaf-89b2-4bf6-8b60-9fb450fe0d0e tempest-ServerDiskConfigTestJSON-1314804263 tempest-ServerDiskConfigTestJSON-1314804263-project-member] Enqueued Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1400.061112] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b693ca-6a80-4111-bfc9-073a1484feae with Priority: HIGHEST for action security_group_members [ 1400.061899] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-02b693ca-6a80-4111-bfc9-073a1484feae taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.061899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.061899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.061899] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.062151] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.062151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.062151] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.062271] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.062308] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.062994] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02b693ca-6a80-4111-bfc9-073a1484feae',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.565261] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.565676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.565676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.565676] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.565793] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.565919] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.566035] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.566100] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.566249] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.566325] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.566412] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae is going to be updated. [ 1400.593021] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.593208] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.593255] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.593419] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.593586] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.602198] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: IN_PROGRESS for 2s [ 1401.631331] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: SUCCESS [ 1401.631678] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.611204] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02b693ca-6a80-4111-bfc9-073a1484feae in Status: SUCCESS [ 1402.611403] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02b693ca-6a80-4111-bfc9-073a1484feae deletion is rescheduled due to dependency. [ 1402.611457] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02b693ca-6a80-4111-bfc9-073a1484feae" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.062204] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.062204] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.063136] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.063580] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1415.064463] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.064820] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1415.598886] env[69647]: INFO networking_nsxv3.common.synchronization [req-df04df5f-8dff-4006-99a2-2b1ad6b3bb7b req-ffaa8652-6545-4ca5-b5e9-1cb3e1f59406 tempest-ServerActionsTestOtherA-2034033283 tempest-ServerActionsTestOtherA-2034033283-project-member] Enqueued Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1415.599685] env[69647]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81759fd-827f-4158-bff1-7caece3251c2 with Priority: HIGHEST for action security_group_members [ 1415.600158] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock member-b81759fd-827f-4158-bff1-7caece3251c2 taken with stack trace [, , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.600367] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.600444] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.600705] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.600796] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.600960] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.601034] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.601154] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.601527] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.601527] env[69647]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b81759fd-827f-4158-bff1-7caece3251c2',) {} {{(pid=69647) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.105096] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.105536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.105536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.105536] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.105652] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.105861] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.106029] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.106138] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.106313] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.106395] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.106489] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b81759fd-827f-4158-bff1-7caece3251c2 is going to be updated. [ 1416.131356] env[69647]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69647) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.131568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.131568] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.131798] env[69647]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.131948] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.139592] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: IN_PROGRESS for 2s [ 1418.149952] env[69647]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b81759fd-827f-4158-bff1-7caece3251c2 in Status: SUCCESS [ 1418.150381] env[69647]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b81759fd-827f-4158-bff1-7caece3251c2 deletion is rescheduled due to dependency. [ 1418.150381] env[69647]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b81759fd-827f-4158-bff1-7caece3251c2" {{(pid=69647) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.601074] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.601514] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1425.601767] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.602098] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.603519] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.603965] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.604513] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.604789] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.605421] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.605783] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.606682] env[69647]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.606967] env[69647]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0